Sound playback method, device, wearable device and storage medium

Abstract

The present disclosure relates to a sound playback method, apparatus, wearable device, and storage medium, comprising: when the wearable device is in a transparent mode, obtaining an ambient sound signal collected by a microphone in a microphone array of the wearable device; performing beamforming processing on the ambient sound signal to obtain a target sound signal, wherein the notch direction of the lobe of the target sound signal points toward the direction of the speaker of the wearable device; and playing the target sound signal. By performing beamforming processing on the ambient sound signal so that the notch direction of the lobe obtained by beamforming points toward the direction of the speaker of the wearable device, the beam direction can be directed outside the ear, and the notch direction can be directed toward the speaker, thereby cutting off the positive feedback path of the speaker playing sound and effectively preventing howling.

Description

Technical Field

[0001] The present disclosure relates to the field of audio processing technology, and in particular to a sound playback method, apparatus, wearable device, and storage medium. Background Art

[0002] Headphone Transparency Mode allows users to clearly hear the other person's voice without removing the headphones. However, improper operation, deformation of the headphones due to bumps, or prolonged use can alter the acoustic path of the headphones, causing the microphone to pick up the sound played by the speaker, resulting in a whistling sound. Summary of the Invention

[0003] To overcome the problems existing in the related art, the present disclosure provides a sound playback method, apparatus, wearable device and storage medium.

[0004] According to a first aspect of an embodiment of the present disclosure, a wearable device is provided, wherein the wearable device includes a microphone array, and the method includes:

[0005] When the wearable device is in a transparent mode, obtaining an ambient sound signal collected by a microphone in the microphone array;

[0006] Performing beamforming processing on the ambient sound signal to obtain a target sound signal, wherein a notch direction of a lobe of the target sound signal points toward a direction of a speaker of the wearable device;

[0007] Play the target sound signal.

[0008] Optionally, performing beamforming processing on the ambient sound signal to obtain a target sound signal includes:

[0009] Performing Fourier transform on each of the ambient sound signals to obtain a frequency domain signal corresponding to each of the ambient sound signals;

[0010] Determining the differential array coefficients and filter output compensation factors corresponding to each of the microphones;

[0011] Processing the frequency domain signal according to the differential array coefficient and the filter output compensation factor to obtain a compensated audio signal, and performing beamforming on the compensated audio signal to obtain a differential audio signal;

[0012] The differential audio signal is transparently filtered using a transparent filter coefficient preset by the wearable device to obtain a target sound signal.

[0013] Optionally, the processing the frequency domain signal to obtain the compensated audio signal according to the differential array coefficient and the filter output compensation factor includes:

[0014] performing differential processing on each of the frequency domain signals according to the differential array coefficients to obtain a differential audio signal corresponding to each of the frequency domain signals;

[0015] synthesizing the differential audio signals to obtain a synthesized audio signal;

[0016] The synthesized audio signal is subjected to filtering output compensation according to the filtering output compensation factor, and beamforming is performed on the synthesized audio signal after filtering output compensation to obtain a differential audio signal.

[0017] Optionally, determining the filtering output compensation factor includes:

[0018] determining an angular frequency according to the frequency of any of the environmental sound signals;

[0019] The filter output compensation factor is determined according to the sign of the imaginary part after Fourier transformation, the angular frequency, the acquisition interval duration, and a preset sound pickup direction parameter.

[0020] Optionally, the filter output compensation factor h L It is determined by the following analytical formula:

[0021]

[0022] Among them, j is the imaginary part sign after the Fourier transform, a is the preset sound pickup direction parameter, τ is the acquisition interval length, and w is the angular frequency.

[0023] Optionally, the microphone array includes a feedforward microphone and a call microphone.

[0024] Optionally, the transparent filter coefficient is determined by:

[0025] Acquire a test audio signal of the test audio received when the wearable device is not worn;

[0026] When the wearable device is worn, obtaining a noise-reduced audio signal of the test audio after the wearable device has reduced the noise;

[0027] generating a test frequency response curve of the test audio signal and a passive noise reduction frequency response curve of the noise reduction audio signal;

[0028] generating a compensation frequency response curve according to the test frequency response curve and the passive noise reduction frequency response curve;

[0029] Determining a reference frequency response curve of the compensation frequency response curve by setting recursive performance parameters of the recursive filter;

[0030] The recursive performance parameter corresponding to the reference frequency response curve is used as the transparent filter coefficient.

[0031] Optionally, determining the reference frequency response curve of the compensation frequency response curve by setting the recursive performance parameters of the recursive filter includes:

[0032] Executing a first recursive performance parameter updating process, the first recursive performance parameter updating step comprising: inputting initial recursive performance parameters into the recursive filter to generate an initial simulated frequency response curve; and updating the recursive performance parameters of the recursive filter based on the initial recursive performance parameters when a difference between an average amplitude of the initial simulated frequency response curve within the preset frequency range and an average amplitude of the compensated frequency response curve within the preset frequency range is greater than a preset average amplitude difference, thereby obtaining updated recursive performance parameters;

[0033] Executing a second recursive performance parameter updating process, the second recursive performance parameter updating process comprising: inputting the updated recursive performance parameters into the recursive filter to generate a corresponding simulated frequency response curve; updating the recursive performance parameters of the recursive filter based on the updated recursive performance parameters, where the difference between an average amplitude of the corresponding simulated frequency response curve within the preset frequency range and an average amplitude of the compensation frequency response curve within the preset frequency range is greater than the preset average amplitude difference and less than the average amplitude difference in a previous recursive performance parameter updating process, and the last recursive performance parameter updating process being the first recursive performance parameter updating process or the second recursive performance parameter updating process executed last;

[0034] Repeat the second recursive performance parameter updating process until the average amplitude difference in the second recursive performance parameter updating process is less than the preset average amplitude difference, and use the simulated frequency response curve generated in the second recursive performance parameter updating process as the reference frequency response curve.

[0035] According to a second aspect of an embodiment of the present disclosure, a sound playback device is provided, characterized in that it is applied to a wearable device, and the wearable device includes a microphone array, including:

[0036] an acquisition module, configured to acquire, when the wearable device is in a transparent mode, an ambient sound signal collected by microphones in a microphone array;

[0037] a beamforming module configured to perform beamforming processing on the ambient sound signal to obtain a target sound signal, wherein a notch direction of a lobe of the target sound signal points toward the direction of the speaker of the wearable device;

[0038] The playing module is configured to play the target sound signal.

[0039] Optionally, the beamforming module includes: a Fourier transform submodule configured to perform Fourier transform on each of the ambient sound signals to obtain a frequency domain signal corresponding to each of the ambient sound signals;

[0040] A first determination submodule is configured to determine a differential array coefficient and a filter output compensation factor corresponding to each of the microphones;

[0041] a second determining submodule, configured to process the frequency domain signal according to the differential array coefficient and the filter output compensation factor to obtain a compensated audio signal, and perform beamforming on the compensated audio signal to obtain a differential audio signal;

[0042] The transparent filtering submodule is configured to perform transparent filtering on the differential audio signal using a transparent filtering coefficient preset by the wearable device to obtain a target sound signal.

[0043] Optionally, the second determining submodule is configured to:

[0044] performing differential processing on each of the frequency domain signals according to the differential array coefficients to obtain a differential audio signal corresponding to each of the frequency domain signals;

[0045] synthesizing the differential audio signals to obtain a synthesized audio signal;

[0046] The synthesized audio signal is subjected to filtering output compensation according to the filtering output compensation factor, and beamforming is performed on the synthesized audio signal after filtering output compensation to obtain a differential audio signal.

[0047] Optionally, the first determining submodule includes:

[0048] a first determining unit, configured to determine an angular frequency according to a frequency of any of the ambient sound signals;

[0049] The second determining unit is configured to determine the filter output compensation factor according to the imaginary part sign after Fourier transformation, the angular frequency, the acquisition interval duration and the preset sound pickup direction parameter.

[0050] Optionally, the filter output compensation factor h L It is determined by the following analytical formula:

[0051]

[0052] Among them, j is the imaginary part sign after the Fourier transform, a is the preset sound pickup direction parameter, τ is the acquisition interval length, and w is the angular frequency.

[0053] Optionally, the microphone array includes a feedforward microphone and a call microphone.

[0054] Optionally, the transparent filtering submodule includes:

[0055] A first acquiring unit is configured to acquire a test audio signal of a test audio received when the wearable device is not worn;

[0056] A second acquiring unit is configured to acquire, when the wearable device is worn, a noise-reduced audio signal of the test audio after noise reduction by the wearable device;

[0057] A first generating unit is configured to generate a test frequency response curve of the test audio signal and a passive noise reduction frequency response curve of the noise reduction audio signal;

[0058] A second generating unit is configured to generate a compensation frequency response curve according to the test frequency response curve and the passive noise reduction frequency response curve;

[0059] a first determining unit configured to determine a reference frequency response curve of the compensated frequency response curve by setting a recursive performance parameter of the recursive filter;

[0060] The second determining unit is configured to use the recursive performance parameter corresponding to the reference frequency response curve as the transparent filtering coefficient.

[0061] Optionally, the first determining unit includes: a first executing subunit configured to execute a first recursive performance parameter updating process, wherein the first recursive performance parameter updating step includes: inputting initial recursive performance parameters into the recursive filter to generate an initial simulated frequency response curve; and when a difference between an average amplitude of the initial simulated frequency response curve within the preset frequency range and an average amplitude of the compensated frequency response curve within the preset frequency range is greater than a preset average amplitude difference, updating the recursive performance parameters of the recursive filter based on the initial recursive performance parameters to obtain updated recursive performance parameters;

[0062] The second execution subunit is configured to execute a second recursive performance parameter updating process, the second recursive performance parameter updating process comprising: inputting the updated recursive performance parameter into the recursive filter to generate a corresponding simulated frequency response curve; updating the recursive performance parameter of the recursive filter based on the updated recursive performance parameter when a difference between an average amplitude of the corresponding simulated frequency response curve within the preset frequency range and an average amplitude of the compensation frequency response curve within the preset frequency range is greater than a preset average amplitude difference and less than an average amplitude difference in a previous recursive performance parameter updating process, wherein the previous recursive performance parameter updating process is the first recursive performance parameter updating process or the second recursive performance parameter updating process that was last executed;

[0063] The second execution sub-unit is further configured to repeatedly execute the second recursive performance parameter updating process until the average amplitude difference in the second recursive performance parameter updating process is less than the preset average amplitude difference, and use the simulated frequency response curve generated in the second recursive performance parameter updating process as the reference frequency response curve.

[0064] According to a third aspect of an embodiment of the present disclosure, there is provided a wearable device, including:

[0065] processor;

[0066] a memory for storing processor-executable instructions;

[0067] Wherein, the processor is configured to:

[0068] When the wearable device is in a transparent mode, obtaining an ambient sound signal collected by microphones in the microphone array;

[0069] Performing beamforming processing on the ambient sound signal to obtain a target sound signal, wherein a notch direction of a lobe of the target sound signal points toward a direction of a speaker of the wearable device;

[0070] Play the target sound signal.

[0071] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided, on which computer program instructions are stored. When the program instructions are executed by a processor, the steps of the sound playback method provided in the first aspect of the present disclosure are implemented.

[0072] The technical solutions provided by the embodiments of the present disclosure may have the following beneficial effects:

[0073] When the wearable device is in transparent mode, the ambient sound signal collected by the microphones in the wearable device's microphone array is obtained; beamforming processing is performed on the ambient sound signal to obtain a target sound signal, wherein the notch direction of the lobe of the target sound signal points in the direction of the speaker of the wearable device; and the target sound signal is played. By performing beamforming processing on the ambient sound signal so that the notch direction of the lobe of the target sound signal points in the direction of the speaker of the wearable device, the beam direction can be directed outside the ear and the notch direction can be directed in the direction of the speaker, thereby cutting off the positive feedback path of the speaker playing sound and effectively preventing howling.

[0074] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0075] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0076] Figure 1 The figure is a flowchart of a sound playing method according to an exemplary embodiment.

[0077] Figure 2 is a schematic diagram of a microphone array according to an exemplary embodiment.

[0078] Figure 3 An implementation according to an exemplary embodiment is shown Figure 1 Flowchart of step S12 in FIG.

[0079] Figure 4 The figure is a schematic diagram showing beamforming according to an exemplary embodiment.

[0080] Figure 5 is a schematic diagram showing a target sound signal according to an exemplary embodiment.

[0081] Figure 6 The figure is a flowchart showing a method for determining a transparent filter coefficient according to an exemplary embodiment.

[0082] Figure 7 The figure is a schematic diagram showing a test frequency response curve and a passive noise reduction frequency response curve according to an exemplary embodiment.

[0083] Figure 8 The figure is a schematic diagram showing a compensation frequency response curve and a reference frequency response curve according to an exemplary embodiment.

[0084] Figure 9 The figure is a block diagram of a sound playing device according to an exemplary embodiment.

[0085] Figure 10 The figure is a block diagram showing a device for sound collection according to an exemplary embodiment. DETAILED DESCRIPTION

[0086] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all possible embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

[0087] Figure 1 This is a flow chart of a sound playing method according to an exemplary embodiment, which is applied to a wearable device, wherein the wearable device includes a microphone array. For example, the wearable device may be a Bluetooth headset, such as Figure 2 As shown, a microphone array can be constructed by using a call microphone and a feedforward microphone, or a new microphone can be added between the feedforward microphone and the feedback microphone, and then a microphone array can be constructed by using the feedforward microphone and the new microphone.

[0088] like Figure 1 As shown, the method includes the following steps.

[0089] In step S11, when the wearable device is in the transparent mode, the ambient sound signal collected by the microphones in the microphone array is obtained.

[0090] Among them, the transparency mode means that when the wearable device is worn, it is easier to hear the sounds in the environment after it is turned on. It is equivalent to amplifying the collected environmental sounds and playing them back, so that even if you do not take off the wearable device, you can clearly hear the sounds in the environment.

[0091] Among them, the ambient sound signal should be collected when the wearable device is in transparent mode and there is sound playing in the wearable device speaker.

[0092] For example, first determine whether the wearable device is in the transparent mode, and continuously monitor the playback status of the speaker. If there is no playback sound on the speaker, there is no need to obtain the ambient sound signals collected by each microphone in the microphone array. Instead, beamforming is performed through the existing technical solution. When it is detected that the speaker is currently in the playback state, such as playing voice, playing music, etc., it is determined that there is playback sound in the wearable device speaker, and then the sound playback method described in the present disclosure is executed.

[0093] In step S12, beamforming processing is performed on the ambient sound signal to obtain a target sound signal, wherein the notch direction of the lobe of the target sound signal points to the direction of the speaker of the wearable device.

[0094] Among them, the direction of the notch of the lobe of the target sound signal pointing to the direction of the speaker of the wearable device can mean that the maximum notch direction is the direction of the speaker of the wearable device, and the beam direction is the direction of the handle of the wearable device and away from the speaker of the wearable device, that is, the maximum gain direction is the handle of the wearable device and away from the speaker of the wearable device. For example, when the call microphone and the feedforward microphone form a microphone array, the beam direction is along the handle of the wearable device pointing to the left front and the right front. When the feedforward microphone and the newly added microphone form a microphone array, the maximum gain direction of the target sound signal is vertically pointing to the outside of the ear, that is, away from the direction of the speaker of the wearable device, and the maximum notch direction of the target sound signal is consistent with the direction of the speaker of the wearable device.

[0095] In step S13, the target sound signal is played.

[0096] It is understandable that the target sound is played through the speaker of the wearable device. In this way, the ambient sound signals collected by the microphone array from different directions are adjusted in the direction of maximum notch and increased gain, so that the notch direction points to the speaker, and the speaker is not affected by the played sound.

[0097] The above technical solution, when the wearable device is in transparent mode, obtains the ambient sound signal collected by the microphones in the wearable device's microphone array; performs beamforming processing on the ambient sound signal to obtain a target sound signal, wherein the notch direction of the lobe obtained by the beamforming points in the direction of the speaker of the wearable device; and plays the target sound signal. By performing beamforming processing on the ambient sound signal so that the notch direction of the lobe obtained by the beamforming points in the direction of the speaker of the wearable device, the beam direction can be directed outside the ear and the notch direction can be directed in the direction of the speaker, thereby cutting off the positive feedback path of the speaker's sound playback and effectively preventing howling.

[0098] Based on the above embodiments, Figure 3 An implementation according to an exemplary embodiment is shown Figure 1 The flowchart of step S12 in step S12, wherein the beamforming processing is performed on the ambient sound signal to obtain the target sound signal, including:

[0099] In step S121, Fourier transform is performed on each of the ambient sound signals to obtain a frequency domain signal corresponding to each of the ambient sound signals.

[0100] Herein, Fourier transform is performed on each of the ambient sound signals, each ambient sound signal is decomposed according to its component frequencies, and the sound pressure level amplitude of each frequency in each ambient sound signal is given.

[0101] Among them, the ambient sound signal can be a signal on the entire frequency spectrum, and the sound frequency that humans can normally hear without causing discomfort is 1KHz to 6KHz. Therefore, the signal on the entire frequency spectrum can be extracted first, and the spare ambient sound signal with a frequency range of 1KHz to 6KHz can be extracted, and then Fourier transform can be performed.

[0102] In step S122 , the differential array coefficients and filter output compensation factors corresponding to the microphones are determined.

[0103] Taking the microphone array including a feedforward microphone and a call microphone as an example, the differential array coefficient for the call microphone is determined based on the imaginary part sign, angular frequency, acquisition interval duration and preset pickup direction parameters after Fourier transform.

[0104] Alternatively, the differential array coefficient of the call microphone can be expressed as: -e j*τ*w*a , where j is the imaginary part sign after Fourier transformation, a is the preset sound pickup direction parameter, τ is the acquisition interval duration, and w is the angular frequency.

[0105] In the embodiment of the present disclosure, the differential array coefficients corresponding to multiple microphones can be stored in a matrix. For example, the differential array coefficients corresponding to the call microphone and the differential array coefficients corresponding to the feedforward microphone are stored as a 1*n differential coefficient matrix. Where n is the number of microphones used to construct the matrix, and “1” here is the differential array coefficient corresponding to the feedforward microphone.

[0106] Optionally, the filter output compensation factor is determined based on the imaginary part sign, angular frequency, acquisition interval duration after Fourier transformation, and preset pickup direction parameters. For example, the acquisition interval duration for collecting ambient sound signals between microphones can be determined based on the physical distance between the microphones and the speed of sound propagation. Figure 4 As shown, "1" is the feedforward microphone and "2" is the call microphone. The physical distance δ between the feedforward microphone and the call microphone is divided by the speed of sound propagation to obtain the collection interval length of the ambient sound signal collected by the feedforward microphone and the call microphone.

[0107] Optionally, the duration of the collection interval for collecting the ambient sound signal by each microphone may be determined according to a collection timestamp of the ambient sound signal collected by each microphone.

[0108] In step S123 , the frequency domain signal is processed according to the differential array coefficient and the filter output compensation factor to obtain a compensated audio signal, and beamforming is performed on the compensated audio signal to obtain a differential audio signal.

[0109] In an embodiment of the present disclosure, processing the frequency domain signal to obtain a compensated audio signal according to the differential array coefficient and the filter output compensation factor includes:

[0110] Differential processing is performed on each frequency domain signal according to the differential array coefficient to obtain a differential audio signal corresponding to each frequency domain signal, and each of the differential audio signals is synthesized to obtain a synthesized audio signal.

[0111] For example, each frequency domain signal is multiplied by the corresponding differential array coefficient to obtain a differential audio signal corresponding to the frequency domain signal, and then the differential audio signals are added to obtain a synthesized audio signal.

[0112] like Figure 4 As shown, the differential array coefficient of the call microphone -e j*τ*w*a The frequency domain signal corresponding to the call microphone is differentially processed to obtain the differential audio signal corresponding to the call microphone. Since the differential array coefficient of the call microphone has a negative sign (that is, the frequency domain signal corresponding to the call microphone is delayed inversely), when multiplying the differential audio signal, the differential audio signal corresponding to the call microphone is first reversed, and then added to the differential audio signal corresponding to the feedforward microphone to obtain a synthesized audio signal.

[0113] Furthermore, according to the filter output compensation factor, the filter compensator performs filter output compensation on the synthesized audio signal to obtain a compensated audio signal.

[0114] Optionally, in step S122, determining the filtering output compensation factor includes:

[0115] The angular frequency is determined according to the frequency of any of the ambient sound signals.

[0116] It's understood that angular frequency represents the phase angle in radians of a sound per unit time. Angular frequency is a physical quantity that describes the speed of an object's vibration. It's related to the inherent properties of the vibration system and, as such, represents the vibration frequency of the object itself. Therefore, the angular frequency determined for any ambient sound signal is the same.

[0117] The differential array coefficient corresponding to each of the frequency domain signals is determined according to the sign of the imaginary part after Fourier transformation, the angular frequency, the acquisition interval duration, and a preset sound pickup direction parameter.

[0118] Optionally, while the wearable device speaker is playing the target sound signal, it continuously monitors whether howling occurs. If howling occurs, the sound pickup direction parameter is adjusted, thereby adjusting the angle of the notch direction and the angle of the beam direction. For example, reducing the sound pickup direction parameter increases the notch direction and decreases the beam direction.

[0119] In the embodiment of the present disclosure, the filter output compensation factor h L It is determined by the following analytical formula:

[0120]

[0121] Among them, j is the imaginary part sign after the Fourier transform, a is the preset sound pickup direction parameter, τ is the acquisition interval length, and w is the angular frequency.

[0122] Among them, the maximum gain direction and the maximum notch direction can usually be adjusted by adjusting the value of the pickup direction parameter. When the pickup direction parameter a is -1, a is substituted into the differential coefficient matrix to obtain the corresponding differential array coefficient, and then the ambient sound propagating to the wearable device from different directions is collected to obtain ambient sound signals with different incident angles θ. After the frequency domain signals of each angle corresponding to each microphone are obtained through Fourier transform, each frequency domain signal is multiplied by the corresponding differential array coefficient in the differential coefficient matrix respectively, and then the differential audio signals corresponding to each frequency domain signal are obtained, and the differential audio signals corresponding to each frequency domain signal are added, and the audio signals obtained after the addition are beamformed, and then the ambient sounds corresponding to different incident angles are represented in the waveform diagram as shown below. Figure 5 The cardioid beam shown in the figure has a maximum gain direction of 0 degrees due to the horn's orientation at 180 degrees. Figure 5 Taking the incident angles of 30 degrees and 90 degrees as examples, when the incident angle of the ambient sound is 30 degrees, after beamforming, the sound signal is between 0.8-1, and when the incident angle of the ambient sound is 90 degrees, after beamforming, the sound signal is between 0.4-0.6. Therefore, it can be found that within the range of 0-180 degrees, the maximum notch direction of the lobe of the sound signal points to the direction of the speaker, and the maximum gain direction points to the outside of the ear, thereby cutting off the positive feedback path of the speaker playing sound and effectively preventing howling.

[0123] In step S124, the differential audio signal is transparently filtered using a transparent filter coefficient preset by the wearable device to obtain a target sound signal.

[0124] The following example illustrates the sound playback method disclosed herein. When a wearable device is in playback mode and the user manually turns on the transparency mode, the configured microphones collect ambient sound from different angles. For example, the call microphone and the feedforward microphone collect ambient sound from different angles.

[0125] Furthermore, before the wearable device leaves the factory, the differential array coefficients corresponding to the call microphone and the feedforward microphone are pre-determined based on the physical distance between the call microphone and the feedforward microphone, and a differential array matrix is constructed. After the call microphone and the feedforward microphone respectively capture ambient sound from different angles, the captured ambient sound is converted into an ambient sound signal, and a Fourier transform is performed on the ambient sound signal corresponding to the call microphone to obtain a frequency domain signal corresponding to the call microphone. The ambient sound signal corresponding to the feedforward microphone is also Fourier transformed to obtain a frequency domain signal corresponding to the feedforward microphone.

[0126] Furthermore, the frequency domain signal corresponding to the call microphone and the frequency domain signal corresponding to the feedforward microphone are substituted into the signal matrix, so that when the wearable device calculates the differential audio signal, the corresponding frequency domain signal in the signal matrix can be multiplied by the corresponding differential array coefficient in the differential array matrix to obtain the differential audio signal corresponding to the microphone.

[0127] Furthermore, the differential audio signal corresponding to the feedforward microphone is added to the differential audio signal corresponding to the call microphone, and the audio signal obtained after the addition is filtered and output compensated according to the filter output compensation factor, and then the audio signal after the filter output compensation is beamformed to obtain a differential audio signal. Finally, the differential audio signal is transparently filtered through the transparent filter coefficient preset by the wearable device to obtain the target sound signal, and the target sound signal is played on the speaker of the wearable device.

[0128] On the basis of one of the above embodiments, Figure 6 is a flow chart showing a method for determining a transparent filter coefficient according to an exemplary embodiment. Figure 6 As shown, the method includes the following steps.

[0129] In step S61, a test audio signal of a test audio received when the wearable device is not worn is obtained.

[0130] Among them, wearable devices used for audio transmission need to undergo acoustic characteristic testing in an anechoic chamber before leaving the factory, and the acoustic characteristics of the wearable device are determined by controlling variables in the anechoic chamber. Generally, it is required that there is no other environmental noise in the anechoic chamber to improve the accuracy of audio signal acquisition. By playing test audio of known frequency and corresponding amplitude in the anechoic chamber, the background noise in the environment is simulated. The test audio is collected by the feedforward microphone and call microphone of the wearable device and converted into a test audio signal.

[0131] In step S62, when the wearable device is worn, a noise-reduced audio signal of the test audio after noise reduction by the wearable device is obtained.

[0132] The noise reduction audio signal is part of the test audio signal that enters the ear canal through the gap between the wearable device and the ear because the user's ear is blocked but not completely blocked when the wearable device is worn, or part of the test audio signal that enters the ear canal through the wearable device as a medium. Due to obstruction and interference in the propagation path, the partial test audio signal at this time is different from the test audio signal in frequency and corresponding amplitude. At this time, the wearable device is in a passive noise reduction state, and the feedback sound in the user's ear canal is collected through the feedback microphone set in the ear canal of the wearable device, and the noise reduction audio signal is determined based on the feedback sound.

[0133] In step S63, a test frequency response curve of the test audio signal and a passive noise reduction frequency response curve of the noise reduction audio signal are generated.

[0134] The test frequency response curve is generated based on the test audio signal, and the passive noise reduction frequency response curve is generated based on the noise reduction audio signal. Figure 7 As shown in the figure, the curve at the upper end is the test frequency response curve, and the curve at the lower end is the passive noise reduction frequency response curve.

[0135] In step S64 , a compensation frequency response curve is generated according to the test frequency response curve and the passive noise reduction frequency response curve.

[0136] In transparent mode, the wearable device needs to perform transparent filtering on the received audio signal and superimpose the filtered audio signal with the noise reduction audio signal to obtain a sound that matches the deaf state. However, due to reasons such as the propagation path, the filtered audio signal may be distorted, resulting in a difference between the superimposed audio signal and the sound in the deaf state. The superimposed audio signal needs to be compensated by the transparent filter. By calculating the difference in sound pressure level amplitude between the test frequency response curve and the noise reduction frequency response curve at the same frequency, the compensation frequency response curve that the transparent filter needs to compensate is generated. See Figure 8The compensated frequency response curve is shown in .

[0137] In step S65 , a reference frequency response curve of the compensated frequency response curve is determined by setting recursive performance parameters of the recursive filter.

[0138] Optionally, a correspondence is established between the compensation frequency response curve and the filter coefficients corresponding to the transparent filter. The transparent filter can be an IIR (Infinite Impulse Response) digital filter, also known as a recursive filter. By setting the relevant parameters of the IIR filter, such as frequency, gain, and amplitude, the IIR filter can simulate a simulated frequency response curve in the same coordinate system as the compensation frequency response curve. By adjusting the relevant parameters of the IIR filter, a reference frequency response curve similar to the compensation frequency response curve is determined. Figure 8 The reference frequency response curve shown in .

[0139] In step S66 , the recursive performance parameter corresponding to the reference frequency response curve is used as the transparent filter coefficient.

[0140] Based on the above embodiment, in step S65, determining the reference frequency response curve of the compensation frequency response curve by setting the recursive performance parameters of the recursive filter includes:

[0141] Executing a first recursive performance parameter updating process, the first recursive performance parameter updating step comprising: inputting initial recursive performance parameters into the recursive filter to generate an initial simulated frequency response curve; and updating the recursive performance parameters of the recursive filter based on the initial recursive performance parameters when a difference between an average amplitude of the initial simulated frequency response curve within the preset frequency range and an average amplitude of the compensated frequency response curve within the preset frequency range is greater than a preset average amplitude difference, thereby obtaining updated recursive performance parameters;

[0142] Executing a second recursive performance parameter updating process, the second recursive performance parameter updating process comprising: inputting the updated recursive performance parameters into the recursive filter to generate a corresponding simulated frequency response curve; updating the recursive performance parameters of the recursive filter based on the updated recursive performance parameters, where the difference between an average amplitude of the corresponding simulated frequency response curve within the preset frequency range and an average amplitude of the compensation frequency response curve within the preset frequency range is greater than the preset average amplitude difference and less than the average amplitude difference in a previous recursive performance parameter updating process, and the last recursive performance parameter updating process being the first recursive performance parameter updating process or the second recursive performance parameter updating process executed last;

[0143] Repeat the second recursive performance parameter updating process until the average amplitude difference in the second recursive performance parameter updating process is less than the preset average amplitude difference, and use the simulated frequency response curve generated in the second recursive performance parameter updating process as the reference frequency response curve.

[0144] The executing of the first recursive performance parameter updating process may be randomly initializing the recursive performance parameter of the recursive filter to obtain the first recursive performance parameter, and obtaining the first recursive signal corresponding to the first recursive performance parameter.

[0145] A first difference between the first recursive signal and the sound pressure level amplitude of the compensated audio signal corresponding to the compensated frequency response curve at the same frequency is calculated, and a first sum is obtained by calculating the sum of the first differences.

[0146] It is determined whether the first recursive signal satisfies a preset recursive condition according to the first sum value, wherein the preset recursive condition may be whether the first sum value is less than a preset threshold value.

[0147] If the first recursive signal satisfies the preset recursive condition, that is, the first sum is less than a preset threshold, a reference frequency response curve corresponding to the compensated frequency response curve is generated according to the first recursive signal.

[0148] If the first recursive signal does not satisfy the preset recursive condition, that is, the first sum is greater than or equal to a preset threshold, the recursive performance parameter of the recursive filter is randomly updated based on the first recursive performance parameter to obtain a second recursive performance parameter, and the first recursive signal is input into the recursive filter to obtain a second recursive signal corresponding to the second recursive performance parameter.

[0149] A second difference between the sound pressure level amplitudes of the second recursive signal and the compensated audio signal at the same frequency is calculated, and a second sum is obtained by calculating the sum of the second differences.

[0150] Determining whether the second recursive signal satisfies the preset recursive condition based on the second sum value. If the second recursive signal satisfies the preset recursive condition, generating a reference frequency response curve corresponding to the compensated frequency response curve based on the second recursive signal.

[0151] If the second recursive signal does not meet the preset recursive condition, a baseline recursive performance parameter is determined from the first recursive performance parameter and the second recursive performance parameter based on the magnitude relationship between the second sum and the first sum. For example, if the second sum is greater than the first sum, the first recursive performance parameter is determined as the baseline recursive performance parameter; if the second sum is less than the first sum, the second recursive performance parameter is determined as the baseline recursive performance parameter.

[0152] Based on the baseline recursive performance parameter, the recursive performance parameter of the recursive filter is randomly updated to obtain a third recursive performance parameter, and a recursive signal corresponding to the baseline recursive performance parameter is input into the recursive filter to obtain a third recursive signal corresponding to the third recursive performance parameter. For example, when the second recursive performance parameter is the baseline recursive performance parameter, the recursive performance parameter of the recursive filter is randomly updated based on the second recursive performance parameter to obtain the third recursive performance parameter.

[0153] A third difference between the sound pressure level amplitudes of the third recursive signal and the compensated audio signal at the same frequency is calculated, and a sum of the third differences is calculated to obtain a third sum.

[0154] determining whether the third recursive signal satisfies the preset recursive condition according to the third sum value, and if the third recursive signal satisfies the preset recursive condition, generating a reference frequency response curve corresponding to the compensated frequency response curve according to the third recursive signal;

[0155] If the third recursive signal does not satisfy the preset recursive condition, determining a reference recursive performance parameter for the next random update of the recursive performance parameter of the recursive filter from the reference recursive performance parameter and the third recursive performance parameter based on the third sum and the difference between the sound pressure level amplitudes of the recursive signal corresponding to the reference recursive performance parameter and the compensated audio signal at the same frequency; and

[0156] The steps of randomly updating the recursive performance parameters of the recursive filter based on the baseline recursive performance parameters and determining the baseline recursive performance parameters for the next random update of the recursive performance parameters of the recursive filter are performed until the recursive signal corresponding to the baseline recursive performance parameters satisfies the preset recursive condition, and generating a baseline frequency response curve corresponding to the compensated frequency response curve based on the recursive signal corresponding to the baseline recursive performance parameters.

[0157] The technical solution disclosed in the present invention can ensure that when the user wears the wearable device in transparent mode, the gain in the speaker direction in the target sound signal is almost close to 0, that is, the target sound signal does not contain the sound emitted by the speaker, the acoustic path of the wearable device changes, and no positive feedback can be formed, which can completely suppress the howling sound.

[0158] Based on the same concept, the present disclosure also provides a sound playing device 900 for executing the steps of the sound playing method provided in the above method embodiment. The device 900 can implement the sound playing method in the form of software, hardware, or a combination of both. Figure 99 is a block diagram of a sound playing device 900 according to an exemplary embodiment. Referring to FIG. 9 , the device 900 includes: an acquisition module 910 , a beamforming module 920 and a playing module 930 .

[0159] The acquisition module 910 is configured to acquire an ambient sound signal collected by a microphone in the microphone array when the wearable device is in the transparent mode;

[0160] a beamforming module 920 configured to perform beamforming processing on the ambient sound signal to obtain a target sound signal, wherein a lobe of the target sound signal points in the direction of the speaker of the wearable device;

[0161] The playing module 930 is configured to play the target sound signal.

[0162] The above-mentioned device performs beamforming processing on the ambient sound signal so that the lobe obtained by beamforming points in the direction of the speaker of the wearable device. The beam direction can be pointed outside the ear and the trap direction can be pointed in the direction of the speaker, thereby cutting off the positive feedback path of the speaker playing sound and effectively preventing howling.

[0163] Optionally, the beamforming module 920 includes: a Fourier transform submodule configured to perform Fourier transform on each ambient sound signal to obtain a frequency domain signal corresponding to each ambient sound signal;

[0164] A first determination submodule is configured to determine a differential array coefficient and a filter output compensation factor corresponding to each of the microphones;

[0165] a second determining submodule, configured to process the frequency domain signal according to the differential array coefficient and the filter output compensation factor to obtain a compensated audio signal, and perform beamforming on the compensated audio signal to obtain a differential audio signal;

[0166] The transparent filtering submodule is configured to perform transparent filtering on the differential audio signal using a transparent filtering coefficient preset by the wearable device to obtain a target sound signal.

[0167] Optionally, the second determining submodule is configured to: perform differential processing on each of the frequency domain signals according to the differential array coefficients to obtain a differential audio signal corresponding to each of the frequency domain signals;

[0168] synthesizing the differential audio signals to obtain a synthesized audio signal;

[0169] The synthesized audio signal is subjected to filtering output compensation according to the filtering output compensation factor, and beamforming is performed on the synthesized audio signal after filtering output compensation to obtain a differential audio signal.

[0170] Optionally, the first determining submodule includes:

[0171] a first determining unit, configured to determine an angular frequency according to a frequency of any of the ambient sound signals;

[0172] The second determining unit is configured to determine the filter output compensation factor according to the imaginary part sign after Fourier transformation, the angular frequency, the acquisition interval duration and the preset sound pickup direction parameter.

[0173] Optionally, the filter output compensation factor h L It is determined by the following analytical formula:

[0174]

[0175] Among them, j is the imaginary part sign after the Fourier transform, a is the preset sound pickup direction parameter, τ is the acquisition interval length, and w is the angular frequency.

[0176] Optionally, the microphone array includes a feedforward microphone and a call microphone.

[0177] Optionally, the transparent filtering submodule includes: a first acquiring unit configured to acquire a test audio signal of a test audio received when the wearable device is not worn;

[0178] A second acquiring unit is configured to acquire, when the wearable device is worn, a noise-reduced audio signal of the test audio after noise reduction by the wearable device;

[0179] A first generating unit is configured to generate a test frequency response curve of the test audio signal and a passive noise reduction frequency response curve of the noise reduction audio signal;

[0180] A second generating unit is configured to generate a compensation frequency response curve according to the test frequency response curve and the passive noise reduction frequency response curve;

[0181] a first determining unit configured to determine a reference frequency response curve of the compensated frequency response curve by setting a recursive performance parameter of the recursive filter;

[0182] The second determining unit is configured to use the recursive performance parameter corresponding to the reference frequency response curve as the transparent filtering coefficient.

[0183] Optionally, the first determining unit includes: a first executing subunit configured to execute a first recursive performance parameter updating process, wherein the first recursive performance parameter updating step includes: inputting initial recursive performance parameters into the recursive filter to generate an initial simulated frequency response curve; and when a difference between an average amplitude of the initial simulated frequency response curve within the preset frequency range and an average amplitude of the compensated frequency response curve within the preset frequency range is greater than a preset average amplitude difference, updating the recursive performance parameters of the recursive filter based on the initial recursive performance parameters to obtain updated recursive performance parameters;

[0184] The second execution subunit is configured to execute a second recursive performance parameter updating process, the second recursive performance parameter updating process comprising: inputting the updated recursive performance parameter into the recursive filter to generate a corresponding simulated frequency response curve; updating the recursive performance parameter of the recursive filter based on the updated recursive performance parameter when a difference between an average amplitude of the corresponding simulated frequency response curve within the preset frequency range and an average amplitude of the compensation frequency response curve within the preset frequency range is greater than a preset average amplitude difference and less than an average amplitude difference in a previous recursive performance parameter updating process, wherein the previous recursive performance parameter updating process is the first recursive performance parameter updating process or the second recursive performance parameter updating process that was last executed;

[0185] The second execution sub-unit is further configured to repeatedly execute the second recursive performance parameter updating process until the average amplitude difference in the second recursive performance parameter updating process is less than the preset average amplitude difference, and use the simulated frequency response curve generated in the second recursive performance parameter updating process as the reference frequency response curve.

[0186] Regarding the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0187] In addition, it is worth noting that for the convenience and simplicity of description, the embodiments described in the specification are all preferred embodiments, and the parts involved are not necessarily necessary for the present invention. For example, the acquisition module 910 and the beamforming module 920 can be independent devices or the same device in specific implementation, and this disclosure does not limit this.

[0188] According to the present disclosure, there is also provided a wearable device, comprising:

[0189] a processor; a memory for storing instructions executable by the processor;

[0190] Wherein, the processor is configured to:

[0191] When the wearable device is in transparent mode, an ambient sound signal collected by a microphone in a microphone array is obtained; beamforming processing is performed on the ambient sound signal to obtain a target sound signal, wherein the notch direction of the lobe of the target sound signal points toward the direction of the speaker of the wearable device; and the target sound signal is played.

[0192] According to an embodiment of the present disclosure, a computer-readable storage medium is further provided, on which computer program instructions are stored. When the program instructions are executed by a processor, the steps of the sound playing method of the present disclosure are implemented.

[0193] Figure 10 1 is a block diagram of a device 1000 for sound collection according to an exemplary embodiment. The device 1000 can be configured as a wearable device, for example, the device 1000 can be a noise-canceling headset in a Bluetooth headset or a headset in a helmet.

[0194] Reference Figure 10 , the device 1000 may include one or more of the following components: a processing component 1002 , a memory 1004 , a power component 1006 , a multimedia component 1008 , an audio component 1010 , an input / output (I / O) interface 1012 , a sensor component 1014 , and a communication component 1016 .

[0195] The processing component 1002 generally controls the overall operation of the device 1000, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 1002 may include one or more processors 1020 to execute instructions to perform all or part of the steps of the above-described sound playback method. In addition, the processing component 1002 may include one or more modules to facilitate interaction between the processing component 1002 and other components. For example, the processing component 1002 may include a multimedia module to facilitate interaction between the multimedia component 1008 and the processing component 1002.

[0196] The memory 1004 is configured to store various types of data to support the operation of the device 1000. Examples of such data include instructions for any application or method operating on the device 1000, contact data, phone book data, messages, pictures, videos, etc. The memory 1004 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0197] The power component 1006 provides power to the various components of the device 1000. The power component 1006 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 1000.

[0198] The multimedia component 1008 includes a screen that provides an output interface between the device 1000 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

[0199] The audio component 1010 is configured to output and / or input audio signals. For example, the audio component 1010 includes a microphone array (MIC array). When the device 1000 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive external audio signals, such as ambient sound signals. The received audio signals can be further stored in the memory 1004 or transmitted via the communication component 1016. In some embodiments, the audio component 1010 also includes a speaker for playing a target sound signal.

[0200] I / O interface 1012 provides an interface between processing component 1002 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0201] Sensor assembly 1014 includes one or more sensors for providing various aspects of the status assessment of device 1000. For example, sensor assembly 1014 can detect the open / closed state of device 1000, the relative positioning of components, such as the display and keypad of device 1000. Sensor assembly 1014 can also detect changes in the position of device 1000 or a component of device 1000, the presence or absence of user contact with device 1000, the orientation or acceleration / deceleration of device 1000, and changes in the temperature of device 1000. Sensor assembly 1014 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 1014 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 1014 can also include an accelerometer, a gyroscope, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0202] The communication component 1016 is configured to facilitate wired or wireless communication between the device 1000 and other devices. The device 1000 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1016 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1016 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0203] In an exemplary embodiment, the device 1000 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above-mentioned sound playback method.

[0204] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 1004 including instructions. The instructions can be executed by the processor 1020 of the apparatus 1000 to perform the above-mentioned sound playing method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0205] In another exemplary embodiment, a computer program product is further provided. The computer program product includes a computer program that can be executed by a programmable device, and the computer program has a code portion for executing the above-mentioned sound playing method when executed by the programmable device.

[0206] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the present disclosure. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the following claims.

[0207] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A sound playing method, characterized in that: Applied to a wearable device, the wearable device includes a microphone array, and the method includes: When the wearable device is in a transparent mode, obtaining an ambient sound signal collected by a microphone in the microphone array; Performing beamforming processing on the ambient sound signal to obtain a target sound signal, wherein a notch direction of a lobe of the target sound signal points toward a direction of a speaker of the wearable device; Playing the target sound signal; The performing beamforming processing on the ambient sound signal to obtain the target sound signal includes: Performing Fourier transform on each of the ambient sound signals to obtain a frequency domain signal corresponding to each of the ambient sound signals; Determining the differential array coefficients and filter output compensation factors corresponding to each of the microphones; performing differential processing on each of the frequency domain signals according to the differential array coefficients to obtain a differential audio signal corresponding to each of the frequency domain signals; synthesizing the differential audio signals to obtain a synthesized audio signal; performing filtering output compensation on the synthesized audio signal according to the filtering output compensation factor, and performing beamforming on the synthesized audio signal after filtering output compensation to obtain a differential audio signal; The differential audio signal is transparently filtered using a transparent filter coefficient preset by the wearable device to obtain a target sound signal.

2. The method according to claim 1, characterized in that The determining of the filtering output compensation factor includes: determining an angular frequency according to the frequency of any of the environmental sound signals; The filter output compensation factor is determined according to the sign of the imaginary part after Fourier transformation, the angular frequency, the acquisition interval duration, and the preset sound pickup direction parameter.

3. The method according to claim 2, characterized in that The filter output compensation factor It is determined by the following analytical formula: Wherein, j is the imaginary part sign after the Fourier transform, a is the preset sound pickup direction parameter, is the collection interval length, is the angular frequency.

4. The method according to claim 1, wherein The microphone array includes a feedforward microphone and a call microphone.

5. The method according to any one of claims 1 to 4, characterized in that The transparent filter coefficient is determined as follows: Acquire a test audio signal of the test audio received when the wearable device is not worn; When the wearable device is worn, obtaining a noise-reduced audio signal of the test audio after the wearable device has reduced the noise; generating a test frequency response curve of the test audio signal and a passive noise reduction frequency response curve of the noise reduction audio signal; generating a compensation frequency response curve according to the test frequency response curve and the passive noise reduction frequency response curve; Determining a reference frequency response curve of the compensation frequency response curve by setting recursive performance parameters of the recursive filter; The recursive performance parameter corresponding to the reference frequency response curve is used as the transparent filter coefficient.

6. The method according to claim 5, characterized in that The step of determining the reference frequency response curve of the compensation frequency response curve by setting the recursive performance parameters of the recursive filter includes: Executing a first recursive performance parameter updating process, the first recursive performance parameter updating step comprising: inputting initial recursive performance parameters into the recursive filter to generate an initial simulated frequency response curve; and updating the recursive performance parameters of the recursive filter based on the initial recursive performance parameters when a difference between an average amplitude of the initial simulated frequency response curve within a preset frequency range and an average amplitude of the compensated frequency response curve within the preset frequency range is greater than a preset average amplitude difference, thereby obtaining updated recursive performance parameters; Executing a second recursive performance parameter updating process, the second recursive performance parameter updating process comprising: inputting the updated recursive performance parameters into the recursive filter to generate a corresponding simulated frequency response curve; updating the recursive performance parameters of the recursive filter based on the updated recursive performance parameters, where the difference between an average amplitude of the corresponding simulated frequency response curve within the preset frequency range and an average amplitude of the compensation frequency response curve within the preset frequency range is greater than the preset average amplitude difference and less than the average amplitude difference in a previous recursive performance parameter updating process, and the last recursive performance parameter updating process being the first recursive performance parameter updating process or the second recursive performance parameter updating process executed last; Repeat the second recursive performance parameter updating process until the average amplitude difference in the second recursive performance parameter updating process is less than the preset average amplitude difference, and use the simulated frequency response curve generated in the second recursive performance parameter updating process as the reference frequency response curve.

7. A sound playing device, characterized in that: Applied to a wearable device, the wearable device includes a microphone array, including: an acquisition module, configured to acquire, when the wearable device is in a transparent mode, an ambient sound signal collected by microphones in a microphone array; a beamforming module configured to perform beamforming processing on the ambient sound signal to obtain a target sound signal, wherein a notch direction of a lobe obtained by the beamforming points in the direction of a speaker of the wearable device; a playing module, configured to play the target sound signal; The beamforming module includes: a Fourier transform submodule configured to perform Fourier transform on each ambient sound signal to obtain a frequency domain signal corresponding to each ambient sound signal; A first determination submodule is configured to determine a differential array coefficient and a filter output compensation factor corresponding to each of the microphones; a second determination submodule configured to perform differential processing on each of the frequency domain signals according to the differential array coefficients to obtain a differential audio signal corresponding to each of the frequency domain signals, synthesize the differential audio signals to obtain a synthesized audio signal, perform filter output compensation on the synthesized audio signal according to the filter output compensation factor, and perform beamforming on the synthesized audio signal after filter output compensation to obtain a differential audio signal; The transparent filtering submodule is configured to perform transparent filtering on the differential audio signal using a transparent filtering coefficient preset by the wearable device to obtain a target sound signal.

8. A wearable device, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: When the wearable device is in a transparent mode, obtaining an ambient sound signal collected by microphones in the microphone array; Performing beamforming processing on the ambient sound signal to obtain a target sound signal, wherein a notch direction of a lobe obtained by the beamforming points in the direction of a speaker of the wearable device; Playing the target sound signal; The performing beamforming processing on the ambient sound signal to obtain the target sound signal includes: Performing Fourier transform on each of the ambient sound signals to obtain a frequency domain signal corresponding to each of the ambient sound signals; Determining the differential array coefficients and filter output compensation factors corresponding to each of the microphones; performing differential processing on each of the frequency domain signals according to the differential array coefficients to obtain a differential audio signal corresponding to each of the frequency domain signals; synthesizing the differential audio signals to obtain a synthesized audio signal; performing filtering output compensation on the synthesized audio signal according to the filtering output compensation factor, and performing beamforming on the synthesized audio signal after filtering output compensation to obtain a differential audio signal; The differential audio signal is transparently filtered using a transparent filter coefficient preset by the wearable device to obtain a target sound signal.

9. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the program instructions are executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images