Sound playing method, device, audio playing device and medium

Abstract

The present disclosure relates to a sound playback method, apparatus, audio playback device, and medium. The sound playback method includes: obtaining ambient sound and in-ear canal sound; determining a target transparency coefficient corresponding to a transparency filter according to a first frequency response curve and a second frequency response curve, where the first frequency response curve is the frequency response curve corresponding to the ambient sound, and the second frequency response curve is the frequency response curve corresponding to the in-ear canal sound; controlling the transparency filter to filter the ambient sound according to the target transparency coefficient to obtain a target sound; and playing the target sound. Through the solution disclosed in the present disclosure, it is possible to make the sound heard by the user consistent with the actual external sound.

Description

Technical Field

[0001] The present disclosure relates to the technical field of audio processing, and particularly to a sound playback method, apparatus, audio playback device, and medium. Background Art

[0002] Audio playback devices such as earphones, as a type of audio player, receive electrical signals sent from a media player or receiver, and use speakers close to the ears to convert them into sound waves that can be heard by people.

[0003] In some cases, when a user wears earphones, the user may pay attention to external sounds. For example, the voices of conversations with others, the announcements of vehicles, the honking of cars when crossing the road, and so on. At this time, it is necessary to switch the earphones to the transparent mode to hear the external ambient sound. In the transparent mode, the user can perceive the external ambient sound without removing the earphones, just like not wearing earphones.

[0004] In related technologies, in the transparent mode, a transparent filter is used to filter the external ambient sound, and then the filtered sound is played by the speakers of the earphones. However, in the current transparent mode, the played sound sometimes does not match the real ambient sound. Summary of the Invention

[0005] To overcome the problems existing in related technologies, the present disclosure provides a sound playback method, apparatus, audio playback device, and medium.

[0006] According to a first aspect of an embodiment of the present disclosure, a sound playback method is provided, which is applied to an audio playback device. The method includes:

[0007] Obtain ambient sound and in-ear sound; determine a target transparency coefficient corresponding to a transparent filter according to a first frequency response curve and a second frequency response curve, where the first frequency response curve is the frequency response curve corresponding to the ambient sound, and the second frequency response curve is the frequency response curve corresponding to the in-ear sound; control the transparent filter to filter the ambient sound according to the target transparency coefficient to obtain a target sound; play the target sound.

[0008] In some embodiments, the determining a target transparency coefficient corresponding to a transparent filter according to a first frequency response curve and a second frequency response curve includes:

[0009] Determine a first average amplitude of the amplitudes within a preset frequency band range in the first frequency response curve; determine a second average amplitude of the amplitudes within the preset frequency band range in the second frequency response curve; determine the target transparency coefficient from at least two transparency coefficients corresponding to the transparent filter according to the first average amplitude and the second average amplitude.

[0010] In some embodiments, determining the target permeability coefficient from at least two permeability coefficients corresponding to the transparency filter according to the first average amplitude and the second average amplitude includes:

[0011] Determining the amplitude difference between the second average amplitude and the first average amplitude; determining the permeability coefficient corresponding to the third average amplitude among the at least two permeability coefficients as the target permeability coefficient, where the difference between the third average amplitude and the amplitude difference is less than a preset threshold.

[0012] In some embodiments, the at least two permeability coefficients corresponding to the transparency filter are determined in the following manner:

[0013] Determining the frequency response curve to be compensated according to a third frequency response curve and a fourth frequency response curve, where the third frequency response curve is the frequency response curve corresponding to the ambient sound collected when the artificial head does not wear the audio playback device in an anechoic chamber environment, and the fourth frequency response curve is the frequency response curve after passive noise reduction of the ambient sound collected when the artificial head wears the audio playback device in the anechoic chamber environment; determining the target frequency response curve according to the frequency response curve to be compensated; and determining the at least two permeability coefficients corresponding to the transparency filter according to the target frequency response curve.

[0014] In some embodiments, determining the at least two permeability coefficients corresponding to the transparency filter according to the target frequency response curve includes:

[0015] Determining the fourth average amplitude of the target frequency response curve within a preset frequency band range; performing equal-number sampling of amplitudes within a range greater than the fourth average amplitude and within a range less than the fourth average amplitude at a set sampling interval to obtain a preset number of amplitudes; and adjusting the permeability coefficients of the transparency filter respectively according to the preset number, with the permeability coefficient of the target frequency response curve as a reference, so that the average amplitude of the frequency response curve of the sound filtered by the transparency filter is the amplitude among the preset number of amplitudes.

[0016] In some embodiments, determining the target permeability coefficient corresponding to the transparency filter according to a first frequency response curve and a second frequency response curve includes:

[0017] Obtaining the original sound played by the audio playback device; determining the echo generated by the original sound in the ear canal according to the original sound; eliminating the echo in the sound in the ear canal and obtaining a second frequency response curve after echo elimination; and determining the target permeability coefficient corresponding to the transparency filter according to the first frequency response curve and the second frequency response curve after echo elimination.

[0018] According to a second aspect of the embodiments of the present disclosure, there is provided a sound playback device, and the device includes:

[0019] An acquisition module for acquiring ambient sound and in-ear sound; a control module for determining a target transparency coefficient corresponding to a transparency filter according to a first frequency response curve and a second frequency response curve, where the first frequency response curve is the frequency response curve corresponding to the ambient sound, the second frequency response curve is the frequency response curve corresponding to the in-ear sound, and controlling the transparency filter to filter the ambient sound according to the target transparency coefficient to obtain a target sound; a playback module for playing the target sound.

[0020] In some embodiments, the control module is configured to determine the target transparency coefficient corresponding to the transparency filter according to the first frequency response curve and the second frequency response curve in the following manner:

[0021] Determine a first average amplitude of the amplitudes in a preset frequency band range in the first frequency response curve; determine a second average amplitude of the amplitudes in the preset frequency band range in the second frequency response curve; and determine the target transparency coefficient from at least two transparency coefficients corresponding to the transparency filter according to the first average amplitude and the second average amplitude.

[0022] In some embodiments, the control module is configured to determine the target transparency coefficient from at least two transparency coefficients corresponding to the transparency filter according to the first average amplitude and the second average amplitude in the following manner, including:

[0023] Determine an amplitude difference between the second average amplitude and the first average amplitude; and determine the transparency coefficient corresponding to a third average amplitude among the at least two transparency coefficients as the target transparency coefficient, where the difference between the third average amplitude and the amplitude difference is less than a preset threshold.

[0024] In some embodiments, the control module is configured to determine the at least two transparency coefficients corresponding to the transparency filter in the following manner:

[0025] Determine a frequency response curve to be compensated according to a third frequency response curve and a fourth frequency response curve, where the third frequency response curve is the frequency response curve corresponding to the ambient sound collected when the artificial head does not wear the audio playback device in an anechoic chamber environment, and the fourth frequency response curve is the frequency response curve after passive noise reduction of the ambient sound collected when the artificial head wears the audio playback device in the anechoic chamber environment; determine a target frequency response curve according to the frequency response curve to be compensated; and determine the at least two transparency coefficients corresponding to the transparency filter according to the target frequency response curve.

[0026] In some embodiments, the control module is configured to determine the at least two transparency coefficients corresponding to the transparency filter according to the target frequency response curve in the following manner:

[0027] Determine the fourth average amplitude of the target frequency response curve within a preset frequency band range; at a set sampling interval, perform equal-number sampling of amplitudes within a range greater than the fourth average amplitude and within a range less than the fourth average amplitude respectively to obtain a preset number of amplitudes; according to the preset number, based on the transparency coefficient of the target frequency response curve, adjust the transparency coefficient of the transparency filter respectively, so that the average amplitude of the frequency response curve of the sound filtered and output by the transparency filter is the amplitude among the preset number of amplitudes.

[0028] In some embodiments, the control module is configured to determine the target transparency coefficient corresponding to the transparency filter according to the first frequency response curve and the second frequency response curve in the following manner:

[0029] Obtain the original sound played by the audio playback device; according to the original sound, determine the echo generated by the original sound in the ear canal; eliminate the echo in the sound in the ear canal and obtain the second frequency response curve after echo elimination; according to the first frequency response curve and the second frequency response curve after echo elimination, determine the target transparency coefficient corresponding to the transparency filter.

[0030] According to the third aspect of the embodiments of the present disclosure, there is provided an audio playback device, which includes a transparency filter and a controller. The controller includes: a processor and a memory for storing processor-executable instructions, wherein the processor is configured to: execute the sound playback method described in any of the foregoing embodiments.

[0031] According to the fourth aspect of the embodiments of the present disclosure, there is provided a storage medium, in which instructions are stored. When the instructions in the storage medium are executed by the processor of the audio playback device, the audio playback device can execute the sound playback method described in any of the foregoing embodiments.

[0032] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects: By obtaining ambient sound and sound in the ear canal, determining the target transparency coefficient corresponding to the transparency filter according to the first frequency response curve corresponding to the ambient sound and the second frequency response curve corresponding to the sound in the ear canal, and filtering the ambient sound according to the target transparency coefficient to obtain the target sound and playing the target sound, so that the sound heard by the user can conform to the ambient sound.

[0033] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] The accompanying drawings herein are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present disclosure and used together with the specification to explain the principles of the present disclosure.

[0035] Figure 1 is a schematic flowchart of a sound playback method shown in an exemplary embodiment of the present disclosure.

[0036] Figure 2 is a schematic diagram of a process for determining echo in a headset shown in an exemplary embodiment of the present disclosure.

[0037] Figure 3 is a schematic curve diagram of a frequency response curve A and a frequency response curve B shown in an exemplary embodiment of the present disclosure.

[0038] Figure 4 is a schematic curve diagram of a frequency response curve C and a frequency response curve D shown in an exemplary embodiment of the present disclosure.

[0039] Figure 5 is a block diagram of a sound playback device shown in an exemplary embodiment of the present disclosure.

[0040] Figure 6 is a block diagram of a device for sound playback shown in an exemplary embodiment of the present disclosure. Detailed implementation manners

[0041] Here, the exemplary embodiments will be described in detail, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present disclosure. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0042] The sound playback method provided by the present disclosure can be applied to an audio playback device, which can be, for example, a head-mounted audio playback device, such as a headset. In the present disclosure, the audio playback device is sometimes taken as an example of a headset for illustration below. Those skilled in the art should understand that it can also be other audio playback devices with the same function, not limited to headsets.

[0043] The sound playback method in the present disclosure can be applied to the audio processing scenario of true wireless stereo (TWS) earphones. Among them, TWS earphones can achieve the transparent transmission of ambient sound in the transparent mode. Among them, the transparent mode can be understood as an ambient sound processing technology. When the user wears the earphones, they can perceive the external ambient sound as if they are not wearing the earphones. In one scenario, when the user wears the earphones and wants to talk to others, they can switch to the transparent mode without taking off the earphones, which is equivalent to the effect of taking off the earphones and enables clear conversation with the other party. The rapid popularization of TWS earphones has increased the usage frequency and duration of users. The transparent transmission of ambient sound is also being studied in the direction of more accurate and natural listening experience.

[0044] However, currently, the transparent mode is achieved by collecting ambient sound through a feedforward microphone on the earphone, filtering it through a transparent filter, and then playing it out through a speaker on the earphone, and superimposing the leaked ambient sound. However, currently, under different wearing methods of the user, the transparent sound heard by the user does not match the actual external ambient sound. For example, when the user wears the earphones loosely, a large amount of external ambient sound leaks into the ear canal through the edge of the earphone. At this time, the sound (i.e., the sound heard by the user) after superimposing the external ambient sound leaking into the ear canal through the edge of the earphone and the sound filtered by the transparent filter through the speaker of the earphone will be higher than the actual external sound. For another example, when the user wears the earphones tightly, less external ambient sound leaks into the ear canal through the edge of the earphone. At this time, the sound (i.e., the sound heard by the user) after superimposing the external ambient sound leaking into the ear canal and the sound filtered by the transparent filter through the speaker of the earphone will be lower than the actual external sound.

[0045] The embodiments of the present disclosure provide a sound playback method. In this method, an audio playback device collects external ambient sound and in-ear canal sound, and determines the filter coefficients of a transparent filter based on the ambient sound and the in-ear canal sound, so that the transparent filter can filter the ambient sound and the in-ear canal sound based on the determined filter coefficients and play the filtered target sound, so that the sound heard by the user can match the ambient sound.

[0046] Figure 1 It is a flowchart of a sound playback method provided according to an exemplary embodiment of the present disclosure. As Figure 1 shown, this sound playback method is applied to an audio playback device, which can be, for example, an earphone. The sound playback method may include the following steps.

[0047] In step S11, obtain ambient sound and in-ear canal sound.

[0048] In step S12, according to the first frequency response curve and the second frequency response curve, determine the target transparency coefficient corresponding to the transparency filter.

[0049] Among them, the first frequency response curve is the frequency response curve corresponding to the ambient sound, and the second frequency response curve is the frequency response curve corresponding to the sound in the ear canal.

[0050] In step S13, control the transparency filter to filter the ambient sound according to the target transparency coefficient to obtain the target sound.

[0051] In step S14, play the target sound.

[0052] It can be understood that the sound heard by the user is the superposition of the played target sound and the ambient sound leaking into the ear canal from the edge of the earphone.

[0053] In some embodiments of the present disclosure, the audio playback device, for example, can be an earphone, and can collect ambient sound using the feedforward microphone of the earphone.

[0054] In some embodiments of the present disclosure, the audio playback device, for example, can be an earphone, and can collect the sound in the ear canal using the feedback microphone of the earphone.

[0055] In some embodiments of the present disclosure, according to the collected ambient sound and the sound in the ear canal, the difference between the sound actually heard by the user and the actual ambient sound outside can be determined, and then this difference can be compensated so that the sound actually heard by the user is consistent with the actual ambient sound outside.

[0056] In some embodiments of the present disclosure, after obtaining the ambient sound, the frequency response curve corresponding to the ambient sound (i.e., the first frequency response curve in the present disclosure) can be calculated. After obtaining the sound in the ear canal, the frequency response curve corresponding to the sound in the ear canal (i.e., the second frequency response curve in the present disclosure) can be calculated. According to the first frequency response curve and the second frequency response curve, determine the sound difference to be compensated, and then determine the transparency filter coefficient (i.e., the transparency coefficient in the present disclosure) that can compensate this sound difference.

[0057] In the embodiments of the present disclosure, by obtaining the ambient sound and the sound in the ear canal, according to the first frequency response curve corresponding to the ambient sound and the second frequency response curve corresponding to the sound in the ear canal, determine the target transparency coefficient corresponding to the transparency filter. Filter the ambient sound according to the target transparency coefficient to obtain the target sound, and play the target sound so that the sound heard by the user can be consistent with the ambient sound.

[0058] When a user usually wears headphones, the headphones play sounds, for example, movie sounds, music sounds, call sounds, etc. In the present disclosure, the sounds played by the headphones are referred to as the original sounds played by the headphones. When the headphones play the original sounds, the sounds in the ear canal include three parts: 1) the sounds leaking in; 2) the sounds output by the transparent filter; 3) the original sounds played by the user. Therefore, in order to more accurately determine the difference between the sounds actually heard by the user and the actual ambient sounds in the outside world, the original sounds played by the headphones can be eliminated from the collected sounds in the ear canal.

[0059] Based on this, in some embodiments of the embodiments of the present disclosure, before S12, the sound playback method provided by the embodiments of the present disclosure may further include: obtaining the original sounds played by the audio playback device; determining the echo corresponding to the original sounds in the ear canal according to the original sounds, and eliminating the echo of the original sounds from the sounds in the ear canal. According to the collected ambient sounds and the sounds in the ear canal after eliminating the echo of the original sounds, the difference between the sounds actually heard by the user and the actual ambient sounds in the outside world can be determined, and then this difference can be compensated so that the sounds actually heard by the user are consistent with the actual ambient sounds in the outside world.

[0060] In some embodiments of the embodiments of the present disclosure, determining the echo corresponding to the original sounds in the ear canal according to the original sounds may include: determining the echo corresponding to the original sounds in the ear canal according to the original sounds and an adaptive echo cancellation filter.

[0061] In some embodiments of the embodiments of the present disclosure, the adaptive echo cancellation filter may be an adaptive echo cancellation filter based on the Least Mean Square (LSM) algorithm, an adaptive echo cancellation filter based on the Normalized Least Mean Square (NLSM) algorithm, a Frequency Domain Adaptive Filter (FDAF), or an Echo Return Loss Enhancement (ERLE) adaptive filter.

[0062] In the embodiments of the present disclosure, an adaptive echo cancellation filter based on the LSM algorithm is adopted.

[0063] Among them, determining the echo corresponding to the original sounds in the ear canal according to the original sounds and the adaptive echo cancellation filter is actually to estimate an approximate echo path to approximate the real echo path (in the embodiments of the present disclosure, it is the ear canal), and then obtain the echo.

[0064] The process of determining the echo corresponding to the original sounds in the ear canal according to the original sounds and the adaptive echo cancellation filter is asFigure 2 as shown

[0065] Figure 2 It is a schematic diagram of the process for determining echo provided by an embodiment of the present disclosure.

[0066] In Figure 2 , the original sound x(n) is respectively input into an adaptive echo cancellation filter and an echo path to obtain an estimated echo signal y(n) and a desired signal y(n)'. The echo signal y(n) is subtracted from the desired signal y(n)' to obtain an error signal e(n) = y(n) - y(n)'. The smaller the error signal e(n), the closer the echo path estimated by the adaptive echo cancellation filter is to the actual echo path (ear canal). When the error signal e(n) is less than a preset value, the estimated echo signal y(n) of the adaptive echo cancellation filter is used as the echo corresponding to the original sound in the ear canal.

[0067] In one implementation, in the present disclosure, the frequency response curve corresponding to the echo of the original sound can be calculated, and according to the initial frequency response curve (second frequency response curve) corresponding to the sound in the ear canal, the second frequency response curve after echo cancellation is obtained. According to the first frequency response curve and the second frequency response curve after echo cancellation, the target transparency coefficient corresponding to the transparency filter is determined.

[0068] In some embodiments of the embodiments of the present disclosure, when generating the second frequency response curve after echo cancellation according to the second frequency response curve and the frequency response curve corresponding to the echo, for any frequency, the loudness of the sound in the ear canal corresponding to this frequency is subtracted from the loudness of the echo corresponding to this frequency to obtain a loudness. Then, the loudnesses obtained for each frequency are connected to obtain the second frequency response curve after echo cancellation.

[0069] It can be understood that the embodiments of the present disclosure do not limit the method for calculating the frequency response curve corresponding to the sound, and any available method for calculating the frequency response curve corresponding to the sound can be applied to the embodiments of the present disclosure.

[0070] In some embodiments of the embodiments of the present disclosure, when determining the sound difference to be compensated according to the first frequency response curve and the second frequency response curve, it can be determined according to the average amplitude within a preset frequency band range of the frequency response curve.

[0071] In the embodiments of the present disclosure, compared with the traditional technology, multiple transparency coefficients (at least two transparency coefficients) of the transparency filter are pre-stored in the audio playback device. Among them, the transparency filter filters the ambient sound based on different transparency coefficients and outputs different target sounds.

[0072] In some embodiments of the embodiments of the present disclosure, when determining the target transparency coefficient corresponding to the transparency filter according to the first frequency response curve and the second frequency response curve, the following method may be adopted: determining the first average amplitude of the amplitudes within the preset frequency band range in the first frequency response curve; determining the second average amplitude of the amplitudes within the preset frequency band range in the second frequency response curve; and determining the target transparency coefficient from at least two transparency coefficients corresponding to the transparency filter according to the first average amplitude and the second average amplitude.

[0073] The embodiments of the present disclosure do not limit the preset frequency band range. In practical applications, the preset frequency band range can be set according to actual needs. For example, the preset frequency band range is from 1 kilohertz (kHz) to 5 kHz.

[0074] In some embodiments of the embodiments of the present disclosure, when determining the average amplitude of the amplitudes within the preset frequency band range in the frequency response curve, the amplitudes within the preset frequency band range in the frequency response curve can be added together, and then the average value is obtained to get the average amplitude of the amplitudes within the preset frequency band range in the frequency response curve.

[0075] The target transparency coefficient involved in the embodiments of the present disclosure is the filter coefficient of the transparency filter that can compensate for the sound difference to be compensated determined according to the first frequency response curve and the second frequency response curve.

[0076] In some embodiments of the embodiments of the present disclosure, determining the target transparency coefficient from at least two transparency coefficients corresponding to the transparency filter according to the first average amplitude and the second average amplitude may include: determining the amplitude difference between the second average amplitude and the first average amplitude; and determining the transparency coefficient corresponding to the third average amplitude among the at least two transparency coefficients as the target transparency coefficient. Wherein, the difference between the third average amplitude and the amplitude difference is less than the preset threshold. In other words, in the present disclosure, the transparency coefficient corresponding to the third average amplitude among the at least two transparency coefficients is determined as the target transparency coefficient, where the third average amplitude is the amplitude that is smaller than the average amplitude corresponding to the current transparency coefficient of the transparency filter by the amplitude difference.

[0077] Exemplarily, the correspondence between the transparency coefficient of the transparency filter and the average amplitude is shown in Table 1.

[0078] Table 1

[0079] Permeability coefficient Average amplitude (unit: dB) X0 25 X1 30 X2 35

[0080] Assume that the current transparency coefficient of the transparency filter is X1, and the average amplitude corresponding to the current transparency coefficient of the transparency filter is 30 dB. The difference between the second average amplitude and the first average amplitude is 5 dB. Then the transparency coefficient X0 corresponding to 25 dB, which is 5 dB smaller than 30 dB, is determined as the target transparency coefficient.

[0081] Assume again that the current permeability coefficient of the permeability filter is X1, and the average amplitude corresponding to the current permeability coefficient of the permeability filter is 30 dB. The difference between the second average amplitude and the first average amplitude is -5 dB. Then, the permeability coefficient X2 corresponding to 35 dB, which is 5 dB greater than 30 dB (i.e., 30 dB minus -5 dB), is determined as the target permeability coefficient.

[0082] In some embodiments of the present disclosure, the multiple permeability coefficients of the permeability filter pre-stored in the audio playback device can be obtained by testing in an anechoic chamber before the audio playback device is put into use. That is, the multiple permeability coefficients of the permeability filter can be understood as factory setting values.

[0083] In the present disclosure, in an anechoic chamber environment, based on when the artificial head wears and does not wear the audio playback device, the corresponding frequency response curves can be determined respectively. Based on the frequency response curves, the frequency response curve to be compensated can be determined, and based on the frequency response curve, the target curve can be determined. Based on the target curve, at least two permeability coefficients corresponding to the permeability filter can be determined.

[0084] In the present disclosure, the frequency response curve corresponding to the ambient sound collected when the artificial head does not wear the audio playback device in the anechoic chamber environment is referred to as the third curve. The frequency response curve after passive noise reduction of the ambient sound collected when the artificial head wears the audio playback device in the anechoic chamber environment is referred to as the fourth curve.

[0085] In some embodiments of the present disclosure, based on the third frequency response curve and the fourth frequency response curve, the frequency response curve to be compensated is determined; based on the frequency response curve to be compensated, the target frequency response curve is determined; based on the target frequency response curve, the at least two permeability coefficients corresponding to the permeability filter are determined.

[0086] Specifically, in an anechoic chamber environment, when the user does not wear the earphone, the ambient sound can be collected by using the feedforward microphone of the earphone, and the frequency response curve A (the third frequency response curve) corresponding to the ambient sound in the anechoic chamber environment is calculated; then, when the user wears the earphone, the sound in the ear canal is collected by using the feedback microphone of the earphone, and the frequency response curve B (the fourth frequency response curve) corresponding to the sound in the ear canal in the anechoic chamber environment is calculated. Figure 3 The curve diagrams of the frequency response curve A and the frequency response curve B shown in an exemplary embodiment of the present disclosure are shown. In the present disclosure, by comparing the frequency response curve A and the frequency response curve B, the passive noise reduction curve is obtained, which is also the frequency response curve to be compensated in the present disclosure, hereinafter referred to as the frequency response curve C.

[0087] In some embodiments of the embodiments of the present disclosure, the frequencies, gains, quality factors (Q values), etc. of multiple Infinite Impulse Response (IIR) filters that make up the transparent filter in the earphone can be adjusted. The transparent filter outputs a curve, and this curve is compared with the frequency response curve to be compensated (frequency response curve C). If the difference between this curve and the frequency response curve to be compensated (frequency response curve C) is smaller than the previous difference, then based on the current frequencies, gains, Q values, etc., the frequencies, gains, Q values, etc. are continuously adjusted. And so on, iterating multiple times until the difference between the curve output by the transparent filter and the frequency response curve to be compensated (frequency response curve C) is stable. The curve output by the transparent filter at this time is used as the target frequency response curve, which can be represented by frequency response curve D hereinafter. Figure 4 The figure shows a schematic curve diagram of frequency response curve C and frequency response curve D shown in an exemplary embodiment of the present disclosure. In the present disclosure, the frequencies, gains, Q values, etc. of multiple IIR filters when the frequency response curve of the filtered output sound corresponds to frequency response curve D can be used as a transparency coefficient of the transparent filter, and this transparency coefficient corresponds to the target frequency response curve, and it can also be understood that this transparency coefficient corresponds to the average amplitude of the target frequency response curve.

[0088] In the present disclosure, when determining at least two transparency coefficients corresponding to the transparent filter according to the target frequency response curve, the following method can be used to determine:

[0089] Determine the fourth average amplitude of the target frequency response curve within a preset frequency band range; at a set sampling interval, perform equal-number sampling of amplitudes within the range greater than the fourth average amplitude and within the range less than the fourth average amplitude respectively to obtain a preset number of amplitudes; according to the preset number, based on the transparency coefficient of the target frequency response curve, adjust the transparency coefficient of the transparent filter respectively so that the average amplitude of the frequency response curve of the sound filtered and output by the transparent filter is the amplitude among the preset number of amplitudes.

[0090] In one example, for the transparency coefficient corresponding to the frequency response curve that is X dB larger than the average amplitude of the target frequency response curve, the frequencies, gains, Q values, etc. of multiple IIR filters can be adjusted until the average amplitude of the curve output by the transparent filter is X dB larger than the average amplitude of the target frequency response curve. The frequencies, gains, Q values, etc. of multiple IIR filters at this time are used as a transparency coefficient of the transparent filter, and this transparency coefficient corresponds to the frequency response curve that is X dB larger than the average amplitude of the target frequency response curve, that is, this transparency coefficient corresponds to the average amplitude that is X dB larger than the average amplitude of the target frequency response curve.

[0091] Wherein, X is a positive value or a negative value. For example, the values of X are 1, 2, 3, 4, 5, -1, -2, -3, -4, and -5 respectively. For another example, the values of X are 0.5, 1, 1.5, 2, 2.5, -0.5, -1, -1.5, -2, and -2.5.

[0092] The embodiments of the present disclosure do not limit the value of X. In practical applications, the value of X can be set according to actual needs. For example, in the present disclosure, 10 groups of transparent filter coefficients can be designed based on the frequency response curve D, where the average amplitudes of D1, D2, D3, D4, and D5 are 1 dB, 2 dB, 3 dB, 4 dB, and 5 dB less than the amplitude of D, and the average amplitudes of D6, D7, D8, D9, and D10 are 1 dB, 2 dB, 3 dB, 4 dB, and 5 dB greater than the amplitude of D.

[0093] After determining at least two transparent coefficients corresponding to the transparent filter, the corresponding relationship between the at least two transparent coefficients and the average amplitude value of the frequency response curve can be stored in the flash memory of the audio playback device. When determining the target transparent coefficient corresponding to the transparent filter, the target transparent coefficient can be determined according to the corresponding relationship between the at least two transparent coefficients and the average amplitude value of the frequency response curve stored in the flash memory of the audio playback device. Then, based on the target transparent coefficient, the frequency, gain, Q value, etc. of multiple IIR filters can be adjusted so that the sound filtered by the transparent filter played by the speaker of the audio playback device and the external environmental sound leaking into the ear canal through the edge of the earphone are superimposed to be consistent with the external environmental sound.

[0094] It should be noted that in an anechoic chamber environment, when determining the transparent coefficient of the transparent filter, the speaker of the audio playback device does not play any other sound except the sound obtained by filtering the environmental sound by the transparent filter.

[0095] Furthermore, it should be noted that for the process of calculating the relevant frequency response curve based on sound, reference can be made to the process of determining the frequency response curve in the related art, and the embodiments of the present disclosure will not elaborate on it here.

[0096] The following describes the sound playback method provided by the embodiments of the present disclosure with specific examples.

[0097] For a certain brand and model of earphone, first, in an anechoic chamber environment, when the artificial head does not wear the prototype corresponding to the earphone, the environmental sound is collected by the feedforward microphone of the prototype, and the frequency response curve corresponding to the environmental sound in the anechoic chamber environment is calculated; then, when the artificial head wears the prototype, the sound in the ear canal is collected by the feedback microphone of the prototype, and the frequency response curve corresponding to the sound in the ear canal in the anechoic chamber environment is calculated. By comparing the two frequency response curves, the frequency response curve to be compensated is obtained.

[0098] Then, adjust the frequencies, gains, Q values, etc. of the multiple IIR filters that make up the transparent filter in the prototype. The transparent filter outputs a curve. Compare this curve with the frequency response curve to be compensated. If the difference between this curve and the frequency response curve to be compensated is smaller than the previous difference, then continue to adjust the frequencies, gains, Q values, etc. based on the current frequencies, gains, Q values, etc. And so on, iterate multiple times until the difference between the curve output by the transparent filter and the frequency response curve to be compensated is stable. Take the curve output by the transparent filter at this time as the target frequency response curve, and take the frequencies, gains, Q values, etc. of the multiple IIR filters at this time as a transparency coefficient of the transparent filter, and this transparency coefficient corresponds to the target frequency response curve, that is, this transparency coefficient corresponds to the average amplitude of the target frequency response curve.

[0099] For the transparency coefficient corresponding to the frequency response curve that is X dB larger than the average amplitude of the target frequency response curve, the frequencies, gains, Q values, etc. of the multiple IIR filters can be adjusted until the average amplitude of the curve output by the transparent filter is X dB larger than the average amplitude of the target frequency response curve. Take the frequencies, gains, Q values, etc. of the multiple IIR filters at this time as a transparency coefficient of the transparent filter, and this transparency coefficient corresponds to the frequency response curve that is X dB larger than the average amplitude of the target frequency response curve, that is, this transparency coefficient corresponds to the average amplitude that is X dB larger than the average amplitude of the target frequency response curve.

[0100] Store the corresponding relationships between the above at least two transparency coefficients and the average amplitudes of the frequency response curves in the flash memory of the earphone corresponding to the prototype that needs to be sold.

[0101] When the user purchases the earphone corresponding to the prototype and switches the earphone to the transparent mode, the feedforward microphone of the earphone collects the ambient sound, and the feedback microphone of the earphone collects the sound in the ear canal. Then calculate the first frequency response curve corresponding to the ambient sound and the second frequency response curve corresponding to the sound in the ear canal. Among them, if the user switches the earphone to the transparent mode while listening to music, then use the adaptive echo cancellation filter based on the LSM algorithm to determine the echo of the above music in the ear canal. Then, subtract the frequency response curve corresponding to the echo of the above music in the ear canal from the second frequency response curve to obtain the second frequency response curve corresponding to the sound in the ear canal after removing the echo.

[0102] Calculate the amplitude difference between the average amplitude of the second frequency response curve and the first frequency response curve within the preset frequency band range. Obtain the corresponding relationships between the above at least two transparency coefficients and the average amplitudes of the frequency response curves from the flash memory of the earphone. Then, determine the transparency coefficient corresponding to the average amplitude that is smaller than the calculated amplitude difference among the at least two transparency coefficients as the target transparency coefficient.

[0103] According to the target transparency coefficient, adjust the frequency, gain, Q value, etc. of multiple IIR filters so that the sound filtered by the transparency filter played by the speaker of the earphone and the external environmental sound leaked into the ear canal through the edge of the earphone are superimposed to match the external environmental sound.

[0104] Based on the same concept, an embodiment of the present disclosure also provides a sound playback device.

[0105] It can be understood that in order to achieve the above functions, the sound playback device provided by the embodiments of the present disclosure includes the corresponding hardware structure and / or software module for executing each function. Combining the units and algorithm steps of the various examples disclosed in the embodiments of the present disclosure, the embodiments of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the manner of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods for each specific application to implement the described function, but such implementation should not be considered to exceed the scope of the technical solution of the embodiments of the present disclosure.

[0106] Figure 5 is a block diagram of a sound playback device shown according to an exemplary embodiment. Refer to Figure 5 , the device 100 includes an acquisition module 101, a control module 102, and a playback module 103.

[0107] The acquisition module 101 is used to acquire environmental sound and in-ear sound. The control module 102 is used to determine the target transparency coefficient corresponding to the transparency filter according to the first frequency response curve and the second frequency response curve, where the first frequency response curve is the frequency response curve corresponding to the environmental sound, and the second frequency response curve is the frequency response curve corresponding to the in-ear sound, and control the transparency filter to filter the environmental sound according to the target transparency coefficient to obtain the target sound. The playback module 103 is used to play the target sound.

[0108] In some embodiments, the control module 102 is used to determine the target transparency coefficient corresponding to the transparency filter according to the first frequency response curve and the second frequency response curve in the following manner:

[0109] Determine the first average amplitude of the amplitudes in the preset frequency band range in the first frequency response curve. Determine the second average amplitude of the amplitudes in the preset frequency band range in the second frequency response curve. Determine the target transparency coefficient from at least two transparency coefficients corresponding to the transparency filter according to the first average amplitude and the second average amplitude.

[0110] In some embodiments, the control module 102 is used to determine the target transparency coefficient from at least two transparency coefficients corresponding to the transparency filter according to the first average amplitude and the second average amplitude in the following manner, including:

[0111] Determine the amplitude difference between the second average amplitude and the first average amplitude. Determine the permeability coefficient corresponding to the third average amplitude among at least two permeability coefficients as the target permeability coefficient, where the difference between the third average amplitude and the amplitude difference is less than a preset threshold.

[0112] In some embodiments, the control module 102 is configured to determine at least two permeability coefficients corresponding to the permeability filter in the following manner:

[0113] According to the third frequency response curve and the fourth frequency response curve, determine the frequency response curve to be compensated. The third frequency response curve is the frequency response curve corresponding to the ambient sound collected when the artificial head does not wear the audio playback device in an anechoic chamber environment, and the fourth frequency response curve is the frequency response curve after passive noise reduction of the ambient sound collected when the artificial head wears the audio playback device in an anechoic chamber environment. Determine the target frequency response curve according to the frequency response curve to be compensated. Determine at least two permeability coefficients corresponding to the permeability filter according to the target frequency response curve.

[0114] In some embodiments, the control module 102 is configured to determine at least two permeability coefficients corresponding to the permeability filter in the following manner according to the target frequency response curve:

[0115] Determine the fourth average amplitude of the target frequency response curve within a preset frequency band range. At a set sampling interval, perform equal-number sampling of amplitudes within a range greater than the fourth average amplitude and within a range less than the fourth average amplitude, respectively, to obtain a preset number of amplitudes. According to the preset number, taking the permeability coefficient of the target frequency response curve as a reference, adjust the permeability coefficient of the permeability filter respectively, so that the average amplitude of the frequency response curve of the sound filtered by the permeability filter is the amplitude among the preset number of amplitudes.

[0116] In some embodiments, the control module 102 is configured to determine the target permeability coefficient corresponding to the permeability filter in the following manner according to the first frequency response curve and the second frequency response curve:

[0117] Obtain the original sound played by the audio playback device. Determine the echo generated by the original sound in the ear canal according to the original sound. Eliminate the echo in the sound in the ear canal and obtain the second frequency response curve after echo elimination. Determine the target permeability coefficient corresponding to the permeability filter according to the first frequency response curve and the second frequency response curve after echo elimination.

[0118] Regarding the device in the above embodiments, the specific manners in which each module performs operations have been described in detail in the embodiments related to the method, and will not be elaborated herein.

[0119] Figure 6FIG. 0 is a block diagram of a device 200 for sound playback shown in accordance with an exemplary embodiment. The device 200 may be provided as an audio playback device, for example, may be provided as a headset, or may be provided as a smart terminal. For example, the device 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0120] Referring to Figure 6 , the device 200 may include one or more of the following components: a processing component 202, a memory 204, a power component 206, a multimedia component 208, an audio component 210, an input / output (I / O) interface 212, a sensor component 214, and a communication component 216.

[0121] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to complete all or part of the steps of the above methods. In addition, the processing component 202 may include one or more modules to facilitate the interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate the interaction between the multimedia component 208 and the processing component 202.

[0122] The memory 204 is configured to store various types of data to support the operation of the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disk, or an optical disk.

[0123] The power component 206 provides power to various components of the device 200. The power component 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 200.

[0124] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can sense not only the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front camera and the rear camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

[0125] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC) that is configured to receive external audio signals when the device 200 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 204 or transmitted via the communication component 216. In some embodiments, the audio component 210 further includes a speaker for outputting audio signals.

[0126] The I / O interface 212 provides an interface between the processing component 202 and a peripheral interface module, which can be a keyboard, a click wheel, buttons, etc. These buttons can include, but are not limited to: a home button, a volume button, a power button, and a lock button.

[0127] The sensor component 214 includes one or more sensors for providing a status assessment of various aspects of the device 200. For example, the sensor component 214 can detect the on / off state of the device 200, the relative positioning of components, such as the display and the keypad of the device 200. The sensor component 214 can also detect a change in the position of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200, and the temperature change of the device 200. The sensor component 214 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor component 214 can also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 214 can further include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0128] The communication component 216 is configured to facilitate communication between the device 200 and other devices in a wired or wireless manner. The device 200 can access a communication standard-based wireless network, such as WiFi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0129] In an exemplary embodiment, the device 200 can be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above method.

[0130] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 204 including instructions, and the above instructions can be executed by a processor 220 of the device 200 to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, Random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0131] It can be further understood that "a plurality of" in the present disclosure means two or more, and other quantifiers are similar thereto. "And / or" describes the association relationship of associated objects and indicates that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after. The singular forms of "a", "the", and "said" are also intended to include the plural forms unless the context clearly indicates otherwise.

[0132] It can be further understood that terms such as "first", "second", etc. are used to describe various information, but this information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other and do not represent a specific order or importance. In fact, the expressions such as "first" and "second" can be used interchangeably. For example, without departing from the scope of the present disclosure, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as the first information.

[0133] It can be further understood that although operations are depicted in the drawings in a particular order in the embodiments of the present disclosure, it should not be construed as requiring that the operations be performed in the particular order shown or in a sequential order, or that all of the illustrated operations be performed to obtain the desired results. In certain circumstances, multitasking and parallel processing may be advantageous.

[0134] Other embodiments of the present disclosure will be readily apparent to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known common knowledge or conventional technical means in the technical field not disclosed herein. The specification and examples are only to be considered as exemplary, and the true scope and spirit of the present disclosure are pointed out by the following claims.

[0135] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes may be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. A method for playing sound, characterized in that, Applied to an audio playback device, the method includes: Obtaining ambient sound and in-ear sound; According to a first frequency response curve and a second frequency response curve, determining a first average amplitude of amplitudes within a preset frequency band range in the first frequency response curve, and a second average amplitude of amplitudes within the preset frequency band range in the second frequency response curve, and determining a target transparency coefficient from at least two transparency coefficients corresponding to a transparency filter according to an amplitude difference between the first average amplitude and the second average amplitude, where the first frequency response curve is the frequency response curve corresponding to the ambient sound, and the second frequency response curve is the frequency response curve corresponding to the in-ear sound; The determining the target transparency coefficient from at least two transparency coefficients corresponding to the transparency filter according to the amplitude difference between the first average amplitude and the second average amplitude includes: Determining the transparency coefficient corresponding to a third average amplitude among the at least two transparency coefficients as the target transparency coefficient, where a difference between the third average amplitude and the amplitude difference is less than a preset threshold; Controlling the transparency filter to filter the ambient sound according to the target transparency coefficient to obtain a target sound; Playing the target sound.

2. The method according to claim 1, wherein The at least two transparency coefficients corresponding to the transparency filter are determined in the following manner: According to a third frequency response curve and a fourth frequency response curve, determining a frequency response curve to be compensated, where the third frequency response curve is the frequency response curve corresponding to the ambient sound collected when an artificial head does not wear the audio playback device in an anechoic chamber environment, and the fourth frequency response curve is the frequency response curve after passive noise reduction of the ambient sound collected when the artificial head wears the audio playback device in the anechoic chamber environment; According to the frequency response curve to be compensated, determining a target frequency response curve; According to the target frequency response curve, determining the at least two transparency coefficients corresponding to the transparency filter.

3. The method according to claim 2, wherein According to the target frequency response curve, determining the at least two transparency coefficients corresponding to the transparency filter includes: Determining a fourth average amplitude of the target frequency response curve within a preset frequency band range; Performing equal-number sampling of amplitudes respectively within a range greater than the fourth average amplitude and within a range less than the fourth average amplitude at a set sampling interval to obtain a preset number of amplitudes; According to the preset number, taking the transparency coefficient of the target frequency response curve as a reference, respectively adjusting the transparency coefficient of the transparency filter so that an average amplitude of the frequency response curve of the sound filtered and output by the transparency filter is an amplitude among the preset number of amplitudes.

4. The method according to claim 1, wherein According to a first frequency response curve and a second frequency response curve, determining a target transparency coefficient corresponding to a transparency filter includes: Obtaining an original sound played by the audio playback device; According to the original sound, determining an echo generated by the original sound in the ear canal; Eliminating the echo in the in-ear sound and obtaining a second frequency response curve after echo elimination; According to the first frequency response curve and the second frequency response curve after echo elimination, determining a target transparency coefficient corresponding to the transparency filter.

5. A sound playback device, characterized in that, The device includes: An obtaining module, configured to obtain ambient sound and in-ear sound; A control module, configured to determine a first average amplitude of amplitudes within a preset frequency band range in the first frequency response curve and a second average amplitude of amplitudes within the preset frequency band range in the second frequency response curve according to the first frequency response curve and the second frequency response curve, and determine a target permeability coefficient from at least two permeability coefficients corresponding to the permeability filter according to an amplitude difference between the first average amplitude and the second average amplitude, where the first frequency response curve is the frequency response curve corresponding to the ambient sound, the second frequency response curve is the frequency response curve corresponding to the sound in the ear canal, and control the permeability filter to filter the ambient sound according to the target permeability coefficient to obtain a target sound; The determining the target permeability coefficient from at least two permeability coefficients corresponding to the permeability filter according to the amplitude difference between the first average amplitude and the second average amplitude includes: Determining the permeability coefficient corresponding to a third average amplitude among the at least two permeability coefficients as the target permeability coefficient, where a difference between the third average amplitude and the amplitude difference is less than a preset threshold; A playback module, configured to play the target sound.

6. The device according to claim 5, characterized in that, The control module is configured to determine the target permeability coefficient corresponding to the permeability filter according to the first frequency response curve and the second frequency response curve in the following manner: Obtain an original sound played by an audio playback device; Determine an echo generated by the original sound in the ear canal according to the original sound; Eliminate the echo in the sound in the ear canal and obtain a second frequency response curve after echo elimination; Determine the target permeability coefficient corresponding to the permeability filter according to the first frequency response curve and the second frequency response curve after echo elimination.

7. An audio playback device, characterized in that, The audio playback device includes a permeability filter and a controller, and the controller includes: a processor and a memory for storing processor-executable instructions, where the processor is configured to: execute the sound playback method according to any one of claims 1 to 4.

8. A storage medium, characterized in that, Instructions are stored in the storage medium, and when the instructions in the storage medium are executed by the processor of the audio playback device, the audio playback device is enabled to execute the sound playback method according to any one of claims 1 to 4.

Images