Method, device, earphone and storage medium for reducing earphone occlusion effect

Abstract

The present disclosure relates to a method, device, earphone and storage medium for reducing the occlusion effect of earphones. The method for reducing the occlusion effect of earphones is applied to earphones, and the method for reducing the occlusion effect of earphones includes: in response to detecting that a user makes a sound, collecting audio data inside and outside the ear canal, performing spectrum analysis on the audio data, and obtaining a first frequency response curve and a second frequency response curve; determining a first target frequency interval; determining a target frequency response curve based on the first frequency response curve and the second frequency response curve within the first target frequency interval; using the frequency response curve of the target frequency response curve within the second target frequency interval as a compensation curve, and based on the compensation curve, determining multiple target filter parameters, and generating a compensation signal for reducing the occlusion effect of the earphones. Through the present disclosure, the earphones can optimize the effect of reducing the occlusion effect of the earphones.

Description

Technical Field

[0001] The present disclosure relates to the field of software development, and in particular to a method, device, earphone and storage medium for reducing earphone occlusion effect. Background Art

[0002] With the progress of society and the improvement of people's living standards, headphones have become an indispensable daily necessity for people, and people have put forward new requirements for the sound quality, practicality and wearing comfort of headphones. However, all kinds of headphones will block or obstruct the wearer's ear canal to a greater or lesser extent during use, especially in-ear headphones, which will lead to the occlusion effect, causing the user's hearing threshold to decrease, making the wearer feel muffled when hearing his own voice. The main reason for the occlusion effect is that after the user wears the headphones, the path for the sound to diffuse outward is blocked, and the sound transmitted by bone conduction cannot be diffused out. The sound characteristics of the occlusion effect are that the sound is strengthened at low frequencies and weakened at high frequencies, and the strengthened bass makes the wearer feel muffled. Therefore, how to reduce the occlusion effect of headphones is still a technical problem that needs to be solved urgently.

[0003] Because the occlusion effect causes sound gain at low frequencies, the relevant technology is to first use the feedback microphone in the headset to collect the sound in the user's ear canal, then use the feedback filter to process the sound in the ear canal to obtain anti-phase noise, and then play the anti-phase noise through the speaker in the headset, and use the obtained anti-phase noise to weaken or offset the low-frequency noise enhancement caused by the occlusion effect.

[0004] In the related art, the occlusion effect can be reduced to a certain extent, but the effect of reducing the occlusion effect often varies. Summary of the invention

[0005] In order to overcome the problems existing in the related art, the present disclosure provides a method, device, earphone and storage medium for reducing the occlusion effect of earphone.

[0006] According to a first aspect of an embodiment of the present disclosure, a method for reducing the occlusion effect of headphones is provided, comprising: in response to detecting that a user makes a sound, collecting audio data outside the ear canal, performing spectrum analysis on the audio data outside the ear canal to obtain a first frequency response curve, and collecting audio data inside the ear canal, performing spectrum analysis on the audio data inside the ear canal to obtain a second frequency response curve; determining a first target frequency interval range, within which, when the first frequency response curve and the second frequency response curve are at the same frequency, the sound intensity value of the first frequency response curve is greater than or equal to the sound intensity value of the second frequency response curve; determining a target frequency response curve based on the first frequency response curve and the second frequency response curve within the first target frequency interval; using the frequency response curve of the target frequency response curve within the second target frequency interval as a compensation curve, and determining a plurality of target filter parameters based on the compensation curve; and generating a compensation signal for reducing the occlusion effect of the headphones based on the plurality of target filter parameters.

[0007] In one implementation, determining the target frequency response curve based on the first frequency response curve and the second frequency response curve within the first target frequency interval includes: determining a difference between a value on the first frequency response curve and a value on the second frequency response curve corresponding to the same frequency within the first target frequency interval; determining a low-frequency gain curve generated by an occlusion effect of the headphone based on the difference, and determining a target sound intensity value based on the low-frequency gain curve; and searching for a psychoacoustic equal-loudness curve that matches the target sound intensity value on a plurality of psychoacoustic equal-loudness curves as the target frequency response curve.

[0008] In one implementation, determining the target sound intensity value based on the low-frequency gain curve includes: taking the maximum value or the average value of the sound intensity values ​​of the low-frequency gain curve within the first target frequency interval as the target sound intensity value.

[0009] In one embodiment, searching for a psychoacoustic equal-loudness curve that matches the target sound intensity value on a plurality of psychoacoustic equal-loudness curves includes: if there is a psychoacoustic equal-loudness curve corresponding to the target sound intensity value among the plurality of psychoacoustic equal-loudness curves, determining the psychoacoustic equal-loudness curve corresponding to the target sound intensity value as the psychoacoustic equal-loudness curve that matches the target sound intensity value; if there is no psychoacoustic equal-loudness curve corresponding to the target sound intensity value among the plurality of psychoacoustic equal-loudness curves, determining the psychoacoustic equal-loudness curve corresponding to a sound intensity value that is closest to the target sound intensity value as the psychoacoustic equal-loudness curve that matches the target sound intensity value.

[0010] In one implementation, determining a plurality of target filter parameters based on the compensation curve comprises: determining filter parameters corresponding to each of the plurality of filters when the output frequency response curves of the plurality of filters are the compensation curve; and obtaining a plurality of target filter parameters based on the filter parameters corresponding to each of the plurality of filters.

[0011] In one implementation, the plurality of target filter parameters satisfy the requirement that the sound intensity values ​​of the plurality of filter output frequency response curves in a range other than the second target frequency interval are 0 or approximately 0.

[0012] According to a second aspect of an embodiment of the present disclosure, there is provided an apparatus for reducing the occlusion effect of headphones, comprising: an analyzing unit, for collecting audio data outside the ear canal in response to detecting that a user makes a sound, performing spectrum analysis on the audio data outside the ear canal to obtain a first frequency response curve, and collecting audio data inside the ear canal, performing spectrum analysis on the audio data inside the ear canal to obtain a second frequency response curve; a determining unit, for determining a first target frequency interval range, within which, when the first frequency response curve and the second frequency response curve are at the same frequency, the sound intensity value of the first frequency response curve is greater than or equal to the sound intensity value of the second frequency response curve; and for determining a target frequency response curve based on the first frequency response curve and the second frequency response curve within the first target frequency interval; and using the frequency response curve of the target frequency response curve within the second target frequency interval as a compensation curve, and determining a plurality of target filter parameters based on the compensation curve; and a generating unit, for generating a compensation signal for reducing the occlusion effect of headphones based on the plurality of target filter parameters.

[0013] In one implementation, the determination unit determines the target frequency response curve based on the first frequency response curve and the second frequency response curve within the first target frequency interval in the following manner: determining a difference between a value on the first frequency response curve and a value on the second frequency response curve corresponding to the same frequency within the first target frequency interval; determining a low-frequency gain curve generated by an occlusion effect of the headphone based on the difference, and determining a target sound intensity value based on the low-frequency gain curve; and searching for a psychoacoustic equal-loudness curve that matches the target sound intensity value on a plurality of psychoacoustic equal-loudness curves as the target frequency response curve.

[0014] In one implementation, the determination unit determines the target sound intensity value based on the low-frequency gain curve in the following manner: taking the maximum sound intensity value or the average sound intensity value of the low-frequency gain curve within the first target frequency interval as the target sound intensity value.

[0015] In one implementation manner, the determining unit searches for a psychoacoustic equal-loudness curve that matches the target sound intensity value on a plurality of psychoacoustic equal-loudness curves in the following manner: if there is a psychoacoustic equal-loudness curve corresponding to the target sound intensity value among the plurality of psychoacoustic equal-loudness curves, the psychoacoustic equal-loudness curve corresponding to the target sound intensity value is determined as the psychoacoustic equal-loudness curve that matches the target sound intensity value; if there is no psychoacoustic equal-loudness curve corresponding to the target sound intensity value among the plurality of psychoacoustic equal-loudness curves, the psychoacoustic equal-loudness curve corresponding to the sound intensity value that is closest to the target sound intensity value is determined as the psychoacoustic equal-loudness curve that matches the target sound intensity value.

[0016] In one implementation, the determination unit determines multiple target filter parameters based on the compensation curve in the following manner: determining filter parameters corresponding to each of the multiple filters when multiple filter output frequency response curves are the compensation curve; and obtaining multiple target filter parameters based on the filter parameters corresponding to each of the multiple filters.

[0017] In one implementation, the plurality of target filter parameters satisfy the requirement that the sound intensity values ​​of the plurality of filter output frequency response curves in a range other than the second target frequency interval are 0 or approximately 0.

[0018] According to a third aspect of an embodiment of the present disclosure, there is provided an earphone, comprising a shell and a controller, a feedback microphone, a feedforward microphone and a speaker arranged on the shell; the feedforward microphone is connected to the controller for collecting audio data outside the ear canal and sending it to the controller; the feedback microphone is connected to the controller for collecting audio data inside the ear canal and sending it to the controller; the controller comprises a memory and a processor, the memory stores executable computer instructions, the processor can call the computer instructions stored in the memory to execute the method described in any one of claims 1 to 6 to generate the compensation signal for reducing the occlusion effect of the earphone; the speaker is connected to the controller for playing the compensation signal output by the controller for reducing the occlusion effect of the earphone.

[0019] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided, wherein instructions are stored in the storage medium. When the instructions in the storage medium are executed by a processor of a terminal, the terminal is enabled to execute the method described in the first aspect or any one of the embodiments of the first aspect.

[0020] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: when a user wears headphones and turns on the headphone occlusion effect reduction function, the frequency spectrum of the audio data outside the ear canal and the audio data inside the ear canal is analyzed respectively to obtain a frequency spectrum curve, and a target frequency response curve is determined within a preset target frequency range. Based on the frequency response curve of the target frequency response curve within the target frequency range, multiple target filter parameters are determined to generate a compensation signal, thereby compensating for the attenuation of the sound intensity in the mid- and high-frequency bands caused by the headphone occlusion effect.

[0021] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0023] Figure 1 is a frequency domain plot of the audio data in the ear canal.

[0024] Figure 2 The figure is a flow chart of a method for reducing the occlusion effect of earphones according to an exemplary embodiment.

[0025] Figure 3 This is a diagram of the basic structure inside an in-ear headphone.

[0026] Figure 4 The present invention is a flow chart showing a method for determining a target frequency response curve according to an exemplary embodiment.

[0027] Figure 5 A schematic diagram of a low-frequency gain curve within a first target frequency interval is shown.

[0028] Figure 6 Psychoacoustic equal loudness curves are shown.

[0029] Figure 7 The present invention is a flowchart showing a method of searching for a psychoacoustic equal loudness curve matching a target sound intensity value according to an exemplary embodiment.

[0030] Figure 8 A psychoacoustic equal loudness curve matching the target sound intensity value is shown.

[0031] Fig. 9 The invention is a flowchart showing a method for determining multiple target filter parameters according to an exemplary embodiment.

[0032] Fig.10 A schematic diagram of a compensation curve obtained based on a target frequency response curve is shown.

[0033] Fig.11 A frequency response curve of compensated audio data in the ear canal is shown.

[0034] Fig.12 The invention is a block diagram of a device for reducing the occlusion effect of earphones according to an exemplary embodiment.

[0035] Fig.13 The invention is a block diagram of a device for reducing the occlusion effect of a headphone according to an exemplary embodiment. DETAILED DESCRIPTION

[0036] Here, exemplary embodiments will be described in detail, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present disclosure.

[0037] The method for reducing the occlusion effect of headphones provided in the present disclosure is applied to a scenario in which the occlusion effect generated by a user wearing headphones is optimized to reduce the occlusion effect.

[0038] Among them, when the user wears headphones and the occlusion effect occurs or not, the frequency domain spatial energy of the audio data in the ear canal is inconsistent. Figure 1 is the frequency domain diagram of the audio data in the ear canal. Figure 1 As shown, curve 1 represents the frequency domain curve of the audio data in the ear canal when the user hears the sound without wearing headphones, and curve 2 represents the frequency domain curve of the audio data in the ear canal that produces an occlusion effect.

[0039] The method for reducing the occlusion effect of headphones provided by the present disclosure is applied to the scenario of reducing the occlusion effect based on the psychoacoustic curve. For example, the method for reducing the occlusion effect of headphones provided by the present disclosure can be applied to the scenario of adaptively adjusting filter parameters based on the psychoacoustic curve to compensate for the sound intensity in the mid-high frequency band.

[0040] Figure 2 is a flow chart of a method for reducing earphone occlusion effect according to an exemplary embodiment. Figure 2 As shown, the method for reducing earphone occlusion effect is used in a terminal, and includes the following steps.

[0041] For the convenience of description in the present disclosure, the curve obtained after performing spectrum analysis on the audio data outside the ear canal is called the first frequency response curve, and the curve obtained after performing spectrum analysis on the audio data inside the ear canal is called the second frequency response curve.

[0042] In step S11, when it is determined that the user makes a sound, audio data outside the ear canal is collected, and spectrum analysis is performed on the audio data outside the ear canal to obtain a first frequency response curve, and audio data inside the ear canal is collected, and spectrum analysis is performed on the audio data inside the ear canal to obtain a second frequency response curve.

[0043] In one embodiment, the present disclosure detects the user's pronunciation status in real time when it is determined that the user is wearing headphones and the function of reducing the headphone occlusion effect is turned on.

[0044] In the disclosed embodiment, a bone conduction sensor in the headset is used to detect the sound emitted by the user in real time. When the user wears the headset and is in a speaking state, a part of the user's voice information is transmitted to the inner ear through air vibration, and another part of the user's voice information is transmitted to the inner ear through facial bone vibration. The capacitive circuit in the bone conduction sensor in the headset converts the bone vibration signal into an analog electrical signal, the analog electrical signal is converted into a digital electrical signal through the digital-to-analog conversion circuit in the bone conduction sensor, and the digital electrical signal is detected by the detection circuit in the bone conduction sensor.

[0045] In the disclosed embodiments, the invention can be applied to in-ear headphones to reduce the occlusion effect. Figure 3 This is the basic structure diagram of the in-ear headphones. The in-ear headphones include a feedback microphone, a feedforward microphone, and a call microphone.

[0046] Among them, a feedforward microphone in the earphone is used to collect audio data outside the ear canal, and a feedback microphone in the earphone is used to collect audio data inside the ear canal.

[0047] In the embodiment of the present disclosure, Fourier transform is used The audio data outside the ear canal and the audio data inside the ear canal in the time domain are converted into the audio data outside the ear canal and the audio data inside the ear canal in the frequency domain. Based on the audio data outside the ear canal and the audio data inside the ear canal in the frequency domain, a first frequency response curve and a second frequency response curve are obtained to realize the conversion from the time domain to the frequency domain.

[0048] For the convenience of description in the present disclosure, the low-frequency interval range that produces the headphone occlusion effect is referred to as the first target frequency interval range.

[0049] In step S12, a first target frequency interval range is determined.

[0050] Wherein, within the first target frequency interval, when the first frequency response curve and the second frequency response curve are at the same frequency, the sound intensity value of the first frequency response curve is greater than or equal to the sound intensity value of the second frequency response curve.

[0051] In the disclosed embodiment, since the headphone occlusion effect is mainly produced in the low frequency band between 200 Hz and 500 Hz, the first target frequency interval is determined to be in the range of 200 Hz to 500 Hz.

[0052] In step S13, a target frequency response curve is determined based on the first frequency response curve and the second frequency response curve within the first target frequency interval.

[0053] In step S14, a frequency response curve of the target frequency response curve within the second target frequency interval is used as a compensation curve, and a plurality of target filter parameters are determined based on the compensation curve.

[0054] In the disclosed embodiment, the frequencies of human sounds are mainly concentrated in the range of 300 Hz to 8 kHz. The occlusion effect of the headphone causes the sound intensity of human sounds to be weakened in the mid-to-high frequency band of 500 Hz to 8 kHz. Therefore, the second target frequency interval is determined to be in the range of 500 Hz to 8 kHz.

[0055] In the disclosed embodiment, the filter refers to an infinite impulse response digital filter (Infinite Impulse Response, IIR) in the earphone. The target filter parameters refer to the parameters of the IIR filter currently used to generate a compensation signal when reducing the earphone occlusion effect.

[0056] In step S15 , a compensation signal for reducing the headphone occlusion effect is generated based on a plurality of target filter parameters.

[0057] In the present disclosure, if the user is in a speaking state, the user's external ear canal audio data and internal ear canal audio data are collected, and the frequency spectrum analysis is performed on the external ear canal audio data and the internal ear canal audio data to obtain the frequency response curve of the external ear canal audio data and the frequency response curve of the internal ear canal audio data, and the target frequency response curve is determined within a preset first target frequency interval. Based on the frequency response curve of the target frequency response curve within a preset second target frequency interval, multiple target filter parameters are determined to generate a compensation signal, thereby compensating for the attenuation of the sound intensity in the mid- and high-frequency bands caused by the earphone occlusion effect.

[0058] Figure 4 is a flow chart showing a method of determining a target frequency response curve according to an exemplary embodiment. Figure 4 As shown, determining a target frequency response curve based on a first frequency response curve and a second frequency response curve located within a first target frequency interval includes the following steps.

[0059] In step S21, the difference between a value on the first frequency response curve and a value on the second frequency response curve corresponding to the same frequency in the first target frequency interval is determined.

[0060] In step S22, based on the difference, a low-frequency gain curve generated by the earphone occlusion effect is determined, and based on the low-frequency gain curve, a target sound intensity value is determined.

[0061] In the present disclosure, the maximum value or the average value of the sound intensity of the low-frequency gain curve within the first target frequency interval is used as the target sound intensity value.

[0062] In the present disclosure, Figure 5 A schematic diagram of a low-frequency gain curve within a first target frequency interval is shown, such as Figure 5 As shown. Curve A is the frequency domain curve of the audio data in the ear canal in the low frequency band of 200Hz to 500Hz when the user hears the sound without wearing headphones (that is, when there is no occlusion effect), and curve B is the frequency domain curve of the audio data in the ear canal in the low frequency band of 200Hz to 500Hz when the user wears headphones to produce an occlusion effect. Determine the difference between the sound intensity value on curve A and the sound intensity value on curve B corresponding to the same frequency in the range of 200Hz to 500Hz, and based on the difference, obtain the low-frequency gain curve of curve C in the low frequency band of 200Hz to 500Hz. Among them, the low-frequency gain curve indicates the size of the enhanced low-frequency sound intensity value caused by the occlusion effect of the headphones. And determine the target sound intensity value based on the low-frequency gain curve.

[0063] In the disclosed embodiment, the low-frequency gain curve selects the maximum value of the sound intensity value or determines the average value of the sound intensity value in the range of 200 Hz to 500 Hz, wherein the average value of the sound intensity value refers to the sum of the sound intensity values ​​corresponding to each sampling point / the total number of sampling points.

[0064] In step S23, a psychoacoustic equal loudness curve matching the target sound intensity value is searched among the multiple psychoacoustic equal loudness curves as the target frequency response curve.

[0065] In the disclosed embodiment, the determined target sound intensity value is used to search for a psychoacoustic equal loudness curve that matches the target sound intensity value on a plurality of psychoacoustic equal loudness curves as the target frequency response curve. Figure 6 The psychoacoustic equal loudness curves are shown as Figure 6 As shown in the figure, the minimum auditory field (MAF) curve represents the minimum sound loudness that the human ear can perceive, and the pain threshold curve represents the maximum sound loudness that the human ear can perceive. Beyond this loudness, the human ear will feel uncomfortable. Among them, psychoacoustics is a marginal discipline that studies the relationship between sound and the hearing caused by sound. The psychoacoustic model is a mathematical expression model of the statistical properties of human hearing.

[0066] In the present disclosure, the difference between the value on the first frequency response curve and the value on the second frequency response curve corresponding to the same frequency in the first target frequency interval is determined, and based on the difference, the low-frequency gain curve generated by the headphone occlusion effect is determined, and the target sound intensity value is determined based on the low-frequency gain curve. A psychoacoustic equal loudness curve matching the target sound intensity value is searched on multiple psychoacoustic equal loudness curves as the target frequency response curve. The present disclosure can obtain a standard target frequency response curve based on a standard psychoacoustic equal loudness curve, which facilitates the subsequent standard adjustment and calibration of the IIR filter parameters, thereby generating a compensation signal to reduce the headphone occlusion effect.

[0067] Figure 7 FIG. 1 is a flowchart of searching for a psychoacoustic equal loudness curve matching a target sound intensity value according to an exemplary embodiment. Figure 7 As shown, searching for a psychoacoustic equal loudness curve matching a target sound intensity value on a plurality of psychoacoustic equal loudness curves includes the following steps.

[0068] In step S31, if there is a psychoacoustic equal loudness curve corresponding to the target sound intensity value among the multiple psychoacoustic equal loudness curves, the psychoacoustic equal loudness curve corresponding to the target sound intensity value is determined as the psychoacoustic equal loudness curve matching the target sound intensity value.

[0069] In the disclosed embodiment, it is assumed that the maximum sound intensity of the low-frequency gain curve in the range of 200 Hz to 500 Hz is 50 dB, and the corresponding frequency is 300 Hz. Based on the maximum sound intensity and the frequency corresponding to the maximum sound intensity, a psychoacoustic equal loudness curve corresponding to the maximum sound intensity is matched among multiple psychoacoustic equal loudness curves. Figure 8 A psychoacoustic equal loudness curve matching the target sound intensity value is shown, such as Figure 8 As shown, the curve in the figure represents the psychoacoustic equal loudness curve corresponding to the matched sound intensity maximum value.

[0070] In step S32, if there is no psychoacoustic equal-loudness curve corresponding to the target sound intensity value among the multiple psychoacoustic equal-loudness curves, the psychoacoustic equal-loudness curve corresponding to the sound intensity value closest to the target sound intensity value is determined as the psychoacoustic equal-loudness curve matching the target sound intensity value.

[0071] In the disclosed embodiment, it is assumed that the maximum sound intensity of the low-frequency gain curve in the range of 200 Hz to 500 Hz is 90 dB, and the corresponding frequency is 400 Hz. Based on the maximum sound intensity and the frequency corresponding to the maximum sound intensity, it is impossible to directly match the psychoacoustic equal loudness curve corresponding to the maximum sound intensity among multiple psychoacoustic equal loudness curves, so the psychoacoustic equal loudness curve corresponding to the sound intensity value closest to the target sound intensity value is determined as the psychoacoustic equal loudness curve matching the target sound intensity value.

[0072] Fig. 9 is a flowchart showing a method of determining multiple target filter parameters according to an exemplary embodiment. Fig. 9 As shown, based on the compensation curve, multiple target filter parameters are determined, including the following steps.

[0073] In step S41, filter parameters corresponding to the plurality of filters when the output frequency response curves of the plurality of filters are compensation curves are determined.

[0074] In step S42, a plurality of target filter parameters are obtained based on the filter parameters corresponding to the plurality of filters.

[0075] In the present disclosure, the multiple target filter parameters satisfy the requirement that the sound intensity values ​​of the multiple filter output frequency response curves in the non-second target frequency interval range are 0 or nearly 0.

[0076] In the embodiment of the present disclosure, the second target frequency range is 500 Hz to 8 kHz. Figure 8 The target frequency response curve corresponding to 500Hz~8kHz is used as the compensation curve, and the sound intensity in the frequency range other than 500Hz~8kHz is made 0. Fig.10 A schematic diagram of a compensation curve obtained based on a target frequency response curve is shown, such as Fig.10 As shown in the figure, the sound intensity value changes significantly only in the range of 500Hz to 8kHz.

[0077] In the disclosed embodiment, the least square method can be used to adjust the frequency, gain, quality factor (Q value), etc. of multiple infinite impulse response filters in the headset. Multiple infinite impulse response filters are superimposed to output a curve, and the curve is compared with the compensation curve. If the difference between the curve and the compensation curve is smaller than the previous difference, the current frequency, gain, Q value, etc. are used as a reference to continue adjusting the frequency, gain, Q value, etc. By analogy, multiple iterations are performed until the difference between the curve output by the superposition of multiple infinite impulse response filters and the compensation curve is stable. The parameters of the multiple infinite impulse response filters at this time are used as the target filter parameters corresponding to each of the multiple filters.

[0078] In the present disclosure, filter parameters corresponding to each of the multiple filters are determined when the multiple filter output frequency response curves are compensation curves. Based on the filter parameters corresponding to each of the multiple filters, multiple target filter parameters are obtained, wherein the multiple target filter parameters satisfy the requirement that the sound intensity values ​​of the multiple filter output frequency response curves in the non-target frequency range are 0 or nearly 0. Based on the multiple target filter parameters, a compensation signal for reducing the occlusion effect of the headphone is generated. Fig.11 A frequency response curve of the audio data in the ear canal after compensation is shown. Fig.11As shown, the sound intensity of the mid-high frequency band is increased compared with the sound intensity of the mid-high frequency band before compensation, thereby improving the impact of the headphone occlusion effect.

[0079] Based on the same concept, the embodiment of the present disclosure also provides a device for reducing the occlusion effect of headphones.

[0080] It is understandable that in order to achieve the above functions, the device for reducing the occlusion effect of headphones provided by the embodiments of the present disclosure includes hardware structures and / or software modules corresponding to the execution of each function. In combination with the units and algorithm steps of the various examples disclosed in the embodiments of the present disclosure, the embodiments of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiments of the present disclosure.

[0081] Fig.12 is a block diagram of a device for reducing earphone occlusion effect according to an exemplary embodiment. Fig.12 The device 100 can be provided as the terminal involved in the above embodiment, including an analyzing unit 101, a determining unit 102 and a generating unit 103.

[0082] The analyzing unit 101 is used for collecting audio data outside the ear canal in response to detecting that the user makes a sound, performing spectrum analysis on the audio data outside the ear canal to obtain a first frequency response curve, and collecting audio data inside the ear canal, performing spectrum analysis on the audio data inside the ear canal to obtain a second frequency response curve; the determining unit 102 is used for determining a first target frequency interval range, and within the first target frequency interval range, when the first frequency response curve and the second frequency response curve are at the same frequency, the sound intensity value of the first frequency response curve is greater than or equal to the sound intensity value of the second frequency response curve; it is also used for determining a target frequency response curve based on the first frequency response curve and the second frequency response curve within the first target frequency interval range; and using the frequency response curve of the target frequency response curve within the second target frequency interval range as a compensation curve, and determining a plurality of target filter parameters based on the compensation curve; the generating unit 103 is used for generating a compensation signal for reducing the occlusion effect of the headphone based on the plurality of target filter parameters.

[0083] In one implementation, the determination unit 102 determines the target frequency response curve based on the first frequency response curve and the second frequency response curve within the first target frequency interval in the following manner: determining the difference between the value on the first frequency response curve and the value on the second frequency response curve corresponding to the same frequency within the first target frequency interval; determining a low-frequency gain curve generated by the headphone occlusion effect based on the difference, and determining a target sound intensity value based on the low-frequency gain curve; and searching for a psychoacoustic equal-loudness curve that matches the target sound intensity value on multiple psychoacoustic equal-loudness curves as the target frequency response curve.

[0084] In one implementation, the determination unit 102 determines the target sound intensity value based on the low-frequency gain curve in the following manner: the maximum sound intensity value or the average sound intensity value of the low-frequency gain curve within the first target frequency interval is used as the target sound intensity value.

[0085] In one implementation manner, the determining unit 102 searches for a psychoacoustic equal-loudness curve that matches the target sound intensity value on multiple psychoacoustic equal-loudness curves in the following manner: if there is a psychoacoustic equal-loudness curve corresponding to the target sound intensity value among the multiple psychoacoustic equal-loudness curves, the psychoacoustic equal-loudness curve corresponding to the target sound intensity value is determined as the psychoacoustic equal-loudness curve that matches the target sound intensity value; if there is no psychoacoustic equal-loudness curve corresponding to the target sound intensity value among the multiple psychoacoustic equal-loudness curves, the psychoacoustic equal-loudness curve corresponding to the sound intensity value that is closest to the target sound intensity value is determined as the psychoacoustic equal-loudness curve that matches the target sound intensity value.

[0086] In one implementation, the determination unit 102 determines multiple target filter parameters based on the compensation curve in the following manner: determining filter parameters corresponding to each of the multiple filters when the output frequency response curves of the multiple filters are compensation curves; and obtaining multiple target filter parameters based on the filter parameters corresponding to each of the multiple filters.

[0087] In one implementation, the multiple target filter parameters satisfy the requirement that the sound intensity values ​​of the multiple filter output frequency response curves in a frequency range other than the second target frequency range are 0 or approximately 0.

[0088] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0089] In an embodiment of the present disclosure, there is also provided an earphone, which includes a shell and a controller, a feedback microphone, a feedforward microphone and a speaker arranged on the shell. The feedforward microphone is connected to the controller and is used to collect audio data outside the ear canal and send it to the controller. The feedback microphone is connected to the controller and is used to collect audio data inside the ear canal and send it to the controller. Among them, the controller includes a memory and a processor, and the memory stores executable computer instructions. The processor can call the computer instructions stored in the memory to execute any of the above-mentioned disclosed embodiments and generate a compensation signal for reducing the occlusion effect of the earphone. The speaker is connected to the controller and is used to play the compensation signal output by the controller for reducing the occlusion effect of the earphone.

[0090] Fig.13 2 is a block diagram of an apparatus for reducing the occlusion effect of headphones according to an exemplary embodiment. For example, the apparatus 200 may be provided as a terminal involved in the above-mentioned embodiment. For example, it may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0091] Reference Fig.13 , the device 200 may include one or more of the following components: a processing component 202 , a memory 204 , a power component 206 , a multimedia component 208 , an audio component 210 , an input / output (I / O) interface 212 , a sensor component 214 , and a communication component 216 .

[0092] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 202 may include one or more modules to facilitate interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.

[0093] The memory 204 is configured to store various types of data to support operations on the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0094] The power component 206 provides power to the various components of the device 200. The power component 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 200.

[0095] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0096] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC), and when the device 200 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 204 or sent via the communication component 216. In some embodiments, the audio component 210 also includes a speaker for outputting audio signals.

[0097] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0098] The sensor assembly 214 includes one or more sensors for providing various aspects of the status assessment of the device 200. For example, the sensor assembly 214 can detect the open / closed state of the device 200, the relative positioning of components, such as the display and keypad of the device 200, the sensor assembly 214 can also detect the position change of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200 and the temperature change of the device 200. The sensor assembly 214 can include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 214 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 can also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0099] The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 can access a wireless network based on a communication standard, such as WiFi, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0100] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0101] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 204 including instructions, and the instructions can be executed by the processor 220 of the device 200 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0102] It is further understood that, although the operations are described in a specific order in the drawings in the embodiments of the present disclosure, it should not be understood as requiring the operations to be performed in the specific order shown or in a serial order, or requiring the execution of all the operations shown to obtain the desired results. In certain environments, multitasking and parallel processing may be advantageous.

[0103] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any modifications, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure.

[0104] It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the scope of the appended claims.

Claims

1. A method for reducing the occlusion effect of headphones, characterized in that: include: In response to detecting that the user makes a sound, collecting audio data outside the ear canal, performing spectrum analysis on the audio data outside the ear canal to obtain a first frequency response curve, and collecting audio data inside the ear canal, performing spectrum analysis on the audio data inside the ear canal to obtain a second frequency response curve; Determine a first target frequency interval range, within which, when the first frequency response curve and the second frequency response curve are at the same frequency, the sound intensity value of the first frequency response curve is greater than or equal to the sound intensity value of the second frequency response curve; Determine a target frequency response curve based on a first frequency response curve and a second frequency response curve within the first target frequency interval; Using a frequency response curve of the target frequency response curve within a second target frequency interval as a compensation curve, and determining a plurality of target filter parameters based on the compensation curve; generating a compensation signal for reducing an occlusion effect of a headphone based on the plurality of target filter parameters; The step of determining a target frequency response curve based on a first frequency response curve and a second frequency response curve located within the first target frequency interval includes: Determine a difference between a value on the first frequency response curve and a value on the second frequency response curve corresponding to the same frequency in the first target frequency interval; Based on the difference, determining a low-frequency gain curve generated by the headphone occlusion effect, and determining a target sound intensity value based on the low-frequency gain curve; A psychoacoustic equal loudness curve matching the target sound intensity value is searched on a plurality of psychoacoustic equal loudness curves to serve as a target frequency response curve.

2. The method according to claim 1, characterized in that The step of determining a target sound intensity value based on the low-frequency gain curve includes: The maximum value or the average value of the sound intensity of the low-frequency gain curve within the first target frequency interval is used as the target sound intensity value.

3. The method according to claim 2, characterized in that The step of searching for a psychoacoustic equal loudness curve that matches the target sound intensity value on a plurality of psychoacoustic equal loudness curves comprises: If there is a psychoacoustic equal-loudness curve corresponding to the target sound intensity value among the multiple psychoacoustic equal-loudness curves, determining the psychoacoustic equal-loudness curve corresponding to the target sound intensity value as the psychoacoustic equal-loudness curve matching the target sound intensity value; If there is no psychoacoustic equal-loudness curve corresponding to the target sound intensity value among the multiple psychoacoustic equal-loudness curves, a psychoacoustic equal-loudness curve corresponding to a sound intensity value closest to the target sound intensity value is determined as the psychoacoustic equal-loudness curve matching the target sound intensity value.

4. The method according to claim 1, characterized in that: Determining a plurality of target filter parameters based on the compensation curve comprises: Determine filter parameters corresponding to each of the plurality of filters when the output frequency response curves of the plurality of filters are the compensation curves; Based on the filter parameters corresponding to each of the multiple filters, multiple target filter parameters are obtained.

5. The method according to claim 4, characterized in that The multiple target filter parameters are satisfied so that the sound intensity values ​​of the multiple filter output frequency response curves in a range other than the second target frequency interval are 0 or approximately 0.

6. A device for reducing the occlusion effect of headphones, characterized in that: include: an analyzing unit, configured to, in response to detecting that a user makes a sound, collect audio data outside the ear canal, perform spectrum analysis on the audio data outside the ear canal to obtain a first frequency response curve, and collect audio data inside the ear canal, perform spectrum analysis on the audio data inside the ear canal to obtain a second frequency response curve; A determination unit, configured to determine a first target frequency interval, within which, when the first frequency response curve and the second frequency response curve are at the same frequency, the sound intensity value of the first frequency response curve is greater than or equal to the sound intensity value of the second frequency response curve; further configured to determine a target frequency response curve based on the first frequency response curve and the second frequency response curve within the first target frequency interval; and use the frequency response curve of the target frequency response curve within the second target frequency interval as a compensation curve, and determine a plurality of target filter parameters based on the compensation curve; A generating unit, configured to generate a compensation signal for reducing an occlusion effect of a headphone based on the plurality of target filter parameters; The determination unit determines the target frequency response curve based on the first frequency response curve and the second frequency response curve within the first target frequency interval in the following manner: Determine a difference between a value on the first frequency response curve and a value on the second frequency response curve corresponding to the same frequency in the first target frequency interval; Based on the difference, determining a low-frequency gain curve generated by the headphone occlusion effect, and determining a target sound intensity value based on the low-frequency gain curve; A psychoacoustic equal loudness curve matching the target sound intensity value is searched on a plurality of psychoacoustic equal loudness curves to serve as a target frequency response curve.

7. A headset, characterized in that: The earphone comprises a housing, and a controller, a feedback microphone, a feedforward microphone and a speaker arranged on the housing; The feedforward microphone is connected to the controller and is used to collect audio data outside the ear canal and send it to the controller; The feedback microphone is connected to the controller and is used to collect audio data in the ear canal and send it to the controller; The controller includes a memory and a processor, the memory stores executable computer instructions, and the processor can call the computer instructions stored in the memory to execute the method according to any one of claims 1 to 5 to generate the compensation signal for reducing the occlusion effect of the headphone; The speaker is connected to the controller and is used to play the compensation signal output by the controller for reducing the occlusion effect of the headphone.

8. A computer-readable storage medium, characterized in that: The storage medium stores instructions, and when the instructions in the storage medium are executed by a processor of the mobile terminal, the mobile terminal is enabled to execute the method according to any one of claims 1 to 5.

Images