Howling suppression device, howling suppression method, and howling suppression program

Abstract

A howling suppression device (100) comprises an adaptive filter unit (101) that, using as a reference signal an output signal outputted to a speaker (3), estimates acoustic feedback characteristics that represent the characteristics of acoustic feedback noise inputted to a microphone (1) from the speaker (3) and, using the estimated acoustic feedback characteristics, removes the acoustic feedback noise from an input signal obtained from the microphone (1), an estimation unit (102) that, on the basis of the acoustic feedback characteristics, estimates acoustic feedback amplitude-frequency characteristics for the frequency domain, a suppression gain calculation unit (103) that, from the acoustic feedback amplitude-frequency characteristics, calculates a suppression gain for the frequency domain for flattening frequency peaks of the acoustic feedback amplitude-frequency characteristics, and a suppression unit (104) that, using the suppression gain, suppresses an output signal from the adaptive filter unit (101) in the frequency domain.

Description

[Technical Field]

[0001] The present disclosure relates to a technique for suppressing feedback caused by acoustic feedback from a speaker to a microphone. [Background technology]

[0002] Patent Document 1 discloses a howling suppression device that includes an adaptive howling canceller that subtracts a simulation signal, which is a signal obtained by processing an audio signal to be output to a speaker using a delay means and an adaptive filter, from an audio signal input from a microphone; a notch filter that performs attenuation processing to reduce the level of specific frequency components in the output signal of the adaptive howling canceller; and a control unit that detects the frequency characteristics of the input signal or the error signal after subtraction by the adaptive howling canceller, and when it detects the occurrence of howling and its frequency based on this frequency characteristic, sets that frequency as a specific frequency component in the notch filter and performs attenuation processing.

[0003] However, with the above-mentioned conventional techniques, it is difficult to stably suppress feedback, and further improvements are needed. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 4186932 specification Summary of the Invention [Problem to be solved by the invention]

[0005] The present disclosure has been made to solve the above problems, and aims to provide a technique that can stably suppress howling. [Means for solving the problem]

[0006] A howling suppression device according to the present disclosure is a howling suppression device that suppresses howling that occurs due to acoustic feedback from a speaker to a microphone when sound picked up by the microphone is amplified by the speaker installed in the same space as the microphone, and includes: an adaptive filter unit that estimates acoustic feedback characteristics that represent characteristics of acoustic feedback sound input from the speaker to the microphone using an output signal output to the speaker as a reference signal, and uses the estimated acoustic feedback characteristics to cancel the acoustic feedback sound from an input signal obtained from the microphone; an estimation unit that estimates acoustic feedback amplitude-frequency characteristics in the frequency domain based on the estimated acoustic feedback characteristics; a suppression gain calculation unit that calculates a suppression gain in the frequency domain from the estimated acoustic feedback amplitude-frequency characteristic to flatten frequency peaks of the acoustic feedback amplitude-frequency characteristic; and a suppression unit that suppresses an output signal from the adaptive filter unit in the frequency domain using the calculated suppression gain. [Effects of the Invention]

[0007] According to the present disclosure, howling can be stably suppressed. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating a configuration of a public address system according to an embodiment of the present disclosure. [Figure 2] 1 is a block diagram showing a configuration of a howling suppression device according to an embodiment of the present invention; [Figure 3] FIG. 3 is a block diagram showing a detailed configuration of an adaptive filter unit shown in FIG. 2. [Figure 4] 10 is a diagram showing an example of filter coefficients estimated in each of a plurality of divided blocks of an MDF adaptive filter and measured acoustic feedback characteristics. FIG. [Figure 5] 10A and 10B are diagrams illustrating an example of an acoustic feedback amplitude-frequency characteristic estimated by an estimation unit and an example of a measured acoustic feedback amplitude-frequency characteristic. [Figure 6] 3 is a block diagram showing a detailed configuration of a suppression gain calculation unit shown in FIG. 2. FIG. [Figure 7] 10 is a diagram showing an example of a smoothing value smthΣW′ calculated by the smoothing processing unit and an average value AVE calculated by the average value calculation unit. FIG. [Figure 8] 10 is a diagram illustrating an example of a suppression gain G calculated by a gain calculation unit. FIG. [Figure 9] FIG. 3 is a block diagram showing a detailed configuration of a suppression unit shown in FIG. 2. [Figure 10] FIG. 10 is a diagram illustrating an example of an acoustic feedback characteristic (time impulse response). [Figure 11] 4 is a flowchart illustrating an operation of a feedback suppression device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0009] (Findings that formed the basis of this disclosure) The above-mentioned Patent Document 1 discloses a feedback suppression device that combines an adaptive filter and a notch filter. However, Patent Document 1 requires a control unit to perform processing to detect the occurrence of feedback and its frequency. Feedback occurs when the gain of a loop including acoustic feedback in which sound amplified from a speaker returns to a microphone becomes greater than 1. Feedback can occur at a single frequency, but can also occur simultaneously at multiple frequencies. When feedback occurs simultaneously at multiple frequencies, it is difficult to distinguish between the audio and feedback and accurately detect only the feedback.

[0010] In particular, because Patent Document 1 uses an adaptive filter, if the filter coefficients are not updated correctly, there is a risk that the loop gain will exceed 1 at multiple frequencies simultaneously. In a feedback suppression device, when a speaker's voice is input to a microphone, acoustic feedback sound from a speaker is also input to the microphone at the same time. When the acoustic feedback sound to be eliminated and a speaker voice unrelated to the acoustic feedback sound are input to the microphone simultaneously, the filter coefficients may not be updated correctly in the adaptive filter, and feedback may occur at multiple frequencies simultaneously. Therefore, Patent Document 1 has a problem in that it is difficult to properly detect the occurrence of feedback and its frequency, and it is difficult to properly control the notch filter and stably suppress feedback.

[0011] In order to solve the above problems, a howling suppression device according to one aspect of the present disclosure is a howling suppression device that suppresses howling that occurs due to acoustic feedback from a speaker to a microphone when sound picked up by the microphone is amplified by the speaker installed in the same space as the microphone, and includes: an adaptive filter unit that estimates acoustic feedback characteristics that represent characteristics of acoustic feedback sound input from the speaker to the microphone using an output signal output to the speaker as a reference signal, and uses the estimated acoustic feedback characteristics to cancel the acoustic feedback sound from an input signal obtained from the microphone; an estimation unit that estimates acoustic feedback amplitude-frequency characteristics in the frequency domain based on the estimated acoustic feedback characteristics; a suppression gain calculation unit that calculates a suppression gain in the frequency domain from the estimated acoustic feedback amplitude-frequency characteristic to flatten frequency peaks of the acoustic feedback amplitude-frequency characteristic; and a suppression unit that suppresses an output signal from the adaptive filter unit in the frequency domain using the calculated suppression gain.

[0012] According to this configuration, the adaptive filter unit eliminates the acoustic feedback sound input from the speaker to the microphone, and the suppression unit suppresses the frequency peak components of the acoustic feedback amplitude-frequency characteristic, thereby enabling stable suppression of howling.

[0013] In the above-described howling suppression device, the adaptive filter section may include a frequency domain adaptive filter that estimates the acoustic feedback characteristic for each of a plurality of divided blocks.

[0014] According to this configuration, a frequency domain adaptive filter that estimates acoustic feedback characteristics for each of a plurality of divided blocks can achieve low delay and reduce the amount of calculation.

[0015] In the above-described howling suppression device, the coefficient update algorithm for each of the plurality of divided blocks is a normalized LMS (Le a st Mean Square).

[0016] According to this configuration, the normalized LMS is used as the coefficient update algorithm for each of the plurality of divided blocks, making it possible to eliminate the acoustic feedback sound input from the speaker to the microphone.

[0017] In the above-described howling suppression device, the coefficient update algorithm for each of the plurality of divided blocks may be independent component analysis.

[0018] According to this configuration, the acoustic feedback sound input from the speaker to the microphone can be eliminated by using independent component analysis as the coefficient update algorithm for each of the plurality of divided blocks.

[0019] In the above-described howling suppression device, the coefficient update gain of the coefficient update algorithm for each of the plurality of divided blocks may decrease as the delay increases.

[0020] According to this configuration, the coefficient update gain of the coefficient update algorithm for each of the plurality of divided blocks decreases as the delay increases, thereby improving the convergence speed of the adaptive filter.

[0021] In the above-described howling suppression device, the acoustic feedback characteristic may be a filter coefficient of the frequency domain adaptive filter, and the estimation unit may calculate a sum of a plurality of filter coefficients estimated for each of the plurality of divided blocks, and estimate the calculated sum as the acoustic feedback amplitude-frequency characteristic.

[0022] According to this configuration, the sum of a plurality of filter coefficients estimated for each of a plurality of divided blocks can be estimated as the acoustic feedback amplitude-frequency characteristic.

[0023] In the above-described howling suppression device, the suppression gain calculation unit may calculate the suppression gain by dividing an average value of the acoustic feedback amplitude-frequency characteristics estimated by the estimation unit by each acoustic feedback amplitude-frequency characteristic.

[0024] According to this configuration, the suppression gain in the frequency domain can be calculated by dividing the average value of the estimated acoustic feedback amplitude-frequency characteristics by each acoustic feedback amplitude-frequency characteristic.

[0025] In the above howling suppression device, the suppression gain calculation section may limit a maximum value of the suppression gain.

[0026] According to this configuration, the maximum value of the suppression gain is limited, so that the frequency peak component of the acoustic feedback amplitude frequency characteristic that causes howling can be suppressed.

[0027] In the above howling suppression device, the suppression gain calculation section may limit a minimum value of the suppression gain.

[0028] According to this configuration, the minimum value of the suppression gain is limited, so that the voice of the speaker contained in the output signal from the adaptive filter section can be suppressed, and deterioration of the sound quality can be prevented.

[0029] In the above-described howling suppression device, the estimation unit may convert the acoustic feedback characteristic in the time domain estimated by the adaptive filter unit into the acoustic feedback characteristic in the frequency domain, and estimate the acoustic feedback amplitude-frequency characteristic in the frequency domain.

[0030] According to this configuration, the acoustic feedback sound can be eliminated from the input signal obtained from the microphone by using an adaptive filter that estimates the acoustic feedback characteristics in the time domain.

[0031] Furthermore, the present disclosure can be realized not only as a feedback suppression device having the above-described characteristic configuration, but also as a feedback suppression method that executes characteristic processing corresponding to the characteristic configuration of the feedback suppression device. Furthermore, the present disclosure can also be realized as a computer program that causes a computer to execute characteristic processing included in such a feedback suppression method. Therefore, the same effects as those of the above-described feedback suppression device can also be achieved in the following other aspects.

[0032] A feedback suppression method according to another aspect of the present disclosure is a feedback suppression method for a feedback suppression device that suppresses feedback that occurs due to acoustic feedback from a speaker to a microphone when sound picked up by the microphone is amplified by the speaker installed in the same space as the microphone, in which an adaptive filter unit estimates acoustic feedback characteristics that represent characteristics of acoustic feedback sound input from the speaker to the microphone using an output signal output to the speaker as a reference signal, and uses the estimated acoustic feedback characteristics to cancel the acoustic feedback sound from an input signal obtained from the microphone, an estimation unit estimates an acoustic feedback amplitude-frequency characteristic in the frequency domain based on the estimated acoustic feedback characteristic, a suppression gain calculation unit calculates a suppression gain in the frequency domain for flattening frequency peaks of the acoustic feedback amplitude-frequency characteristic from the estimated acoustic feedback amplitude-frequency characteristic, and a suppression unit uses the calculated suppression gain to suppress an output signal from the adaptive filter unit in the frequency domain.

[0033] A feedback suppression program according to another aspect of the present disclosure is a feedback suppression program for suppressing feedback that occurs due to acoustic feedback from a speaker to a microphone when sound picked up by the microphone is amplified by the speaker installed in the same space as the microphone, the program causing a computer to function as an adaptive filter unit that estimates acoustic feedback characteristics that represent characteristics of acoustic feedback sound input from the speaker to the microphone using an output signal output to the speaker as a reference signal, and uses the estimated acoustic feedback characteristics to cancel the acoustic feedback sound from an input signal obtained from the microphone; an estimation unit that estimates an acoustic feedback amplitude-frequency characteristic in the frequency domain based on the estimated acoustic feedback characteristic; a suppression gain calculation unit that calculates a suppression gain in the frequency domain from the estimated acoustic feedback amplitude-frequency characteristic to flatten frequency peaks of the acoustic feedback amplitude-frequency characteristic; and a suppression unit that suppresses an output signal from the adaptive filter unit in the frequency domain using the calculated suppression gain.

[0034] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. Note that the following embodiments are examples of specific embodiments of the present disclosure and do not limit the technical scope of the present disclosure.

[0035] (Embodiment) 1 is a diagram showing the configuration of a public address system according to an embodiment of the present disclosure. The public address system shown in FIG.

[0036] The public address system includes a microphone 1, an amplifier 2, a speaker 3, and a feedback suppression device 100. The public address system amplifies the voice of a driver 4 in a first-row seat to convey the voice to a passenger 5 in a third-row seat.

[0037] The microphone 1 picks up the voice of the speaker. The microphone 1 is installed near the first row seat where the driver 4 is seated, and picks up the voice of the driver 4 speaking.

[0038] The speaker 3 is installed near the third-row seat in the same space as the microphone 1, and amplifies the voice of the driver 4 picked up by the microphone 1. A passenger 5 in the third-row seat hears the voice of the driver 4 amplified by the speaker 3.

[0039] The howling suppressor 100 suppresses howling caused by acoustic feedback from the speaker 3 to the microphone 1 .

[0040] The amplifier 2 amplifies the output of the feedback suppressor 100 .

[0041] The voice of a driver 4 in a first-row seat is picked up by a microphone 1, passes through a howling suppression device 100, is amplified by an amplifier 2, is amplified by a speaker 3 near a third-row seat, and is transmitted to a passenger 5 in a third-row seat.

[0042] Although the loudspeaker system in this embodiment includes a microphone 1 installed near the first-row seats and a speaker 3 installed near the third-row seats, the present disclosure is not particularly limited thereto. The loudspeaker system may further include a second microphone installed near the third-row seats to pick up sounds spoken by passengers 5, and a second speaker installed near the first-row seats to amplify the sounds picked up by the second microphone. In this case, the loudspeaker system may further include a second feedback suppression device that suppresses feedback generated by acoustic feedback from the second speaker to the second microphone, and a second amplifier that amplifies the output of the second feedback suppression device. The configurations of the second microphone, second speaker, second feedback suppression device, and second amplifier are the same as those of the microphone 1, speaker 3, feedback suppression device 100, and amplifier 2.

[0043] Furthermore, in this embodiment, the microphone 1 and the speaker 3 are installed inside the vehicle 10, but the present disclosure is not particularly limited to this, and they may be installed inside a room.

[0044] FIG. 2 is a block diagram showing the configuration of howling suppression apparatus 100 according to this embodiment.

[0045] The howling suppression device 100 includes an adaptive filter unit 101 , an estimation unit 102 , a suppression gain calculation unit 103 , and a suppression unit 104 .

[0046] The adaptive filter unit 101 uses the output signal output to the speaker 3 as a reference signal to estimate acoustic feedback characteristics that represent the characteristics of acoustic feedback sound input from the speaker 3 to the microphone 1. The adaptive filter unit 101 uses the estimated acoustic feedback characteristics to cancel the acoustic feedback sound from the input signal obtained from the microphone 1. The adaptive filter unit 101 estimates the characteristics of the acoustic path from the speaker 3 to the microphone 1 using a coefficient update algorithm (adaptive algorithm), and cancels sound that is included in the input signal from the microphone 1 and that sneaks from the speaker 3 to the microphone 1.

[0047] The estimation unit 102 estimates the acoustic feedback amplitude-frequency characteristic in the frequency domain based on the acoustic feedback characteristic estimated by the adaptive filter unit 101 .

[0048] The suppression gain calculation unit 103 calculates a frequency domain suppression gain for flattening frequency peaks of the acoustic feedback amplitude frequency characteristic from the acoustic feedback amplitude frequency characteristic estimated by the estimation unit 102. The suppression gain calculation unit 103 calculates a suppression gain for suppressing peaks of the acoustic feedback amplitude frequency characteristic leaking from the speaker 3 to the microphone 1 from the acoustic feedback amplitude frequency characteristic estimated by the estimation unit 102.

[0049] The suppression gain calculation unit 103 calculates a suppression gain by dividing the average value of the acoustic feedback amplitude-frequency characteristic estimated by the estimation unit 102 by each acoustic feedback amplitude-frequency characteristic. The suppression gain calculation unit 103 limits the maximum value of the suppression gain and also limits the minimum value of the suppression gain. Note that the detailed configuration of the suppression gain calculation unit 103 will be described later.

[0050] The suppression unit 104 suppresses the output signal from the adaptive filter unit 101 in the frequency domain using the suppression gain calculated by the suppression gain calculation unit 103. The suppression unit 104 multiplies the output signal from the adaptive filter unit 101 by the suppression gain. The detailed configuration of the suppression unit 104 will be described later.

[0051] FIG. 3 is a block diagram showing a detailed configuration of adaptive filter unit 101 shown in FIG.

[0052] The adaptive filter unit 101 is an MDF (Multidelay Block Frequency Domain) adaptive filter. The MDF adaptive filter is disclosed in the document "Multidelay Block Frequency Domain Adaptive Filter" (JIA-SIEN SOO and KHEE K. PANG, IEEE Transactions on Acoustics, Speech, and Signal Processing, February 1990, vol. 38, no. 2, pp. 373-376). Therefore, a detailed description of the MDF adaptive filter will be omitted.

[0053] The adaptive filter unit 101 includes serial / parallel (S / P) conversion units 411 and 412, a parallel / serial (P / S) conversion unit 413, fast Fourier transform (FFT) units 421 and 423, an inverse fast Fourier transform (IFFT) unit 422, first to Nth frequency domain adaptive filters 431 to 43N, a sum calculation unit 44, and an error calculation unit 45.

[0054] Serial / parallel conversion units 411 and 412 convert serial data into parallel data. Serial / parallel conversion unit 411 converts a serial output signal output from suppression unit 104 to speaker 3 into a parallel output signal. Serial / parallel conversion unit 412 converts a serial input signal obtained from microphone 1 into a parallel input signal.

[0055] The parallel / serial converter 413 converts parallel data into serial data. The parallel / serial converter 413 converts the parallel output signal output from the adaptive filter 101 to the suppressor 104 into a serial output signal.

[0056] The fast Fourier transform units 421 and 423 perform discrete Fourier transform at high speed. The fast Fourier transform unit 421 converts the time domain output signal input from the serial / parallel conversion unit 411 to the first to Nth frequency domain adaptive filters 431 to 43N into a frequency domain output signal. The fast Fourier transform unit 423 converts the time domain error signal output from the error calculation unit 45 into a frequency domain error signal.

[0057] The inverse fast Fourier transform unit 422 performs an inverse discrete Fourier transform at high speed. The inverse fast Fourier transform unit 422 converts the pseudo signal in the frequency domain, which is output from the sum calculation unit 44 to the error calculation unit 45 and which imitates the audio signal fed back from the speaker 3 to the microphone 1, into a pseudo signal in the time domain.

[0058] The first to N-th frequency domain adaptive filters 431 to 43N generate pseudo signals indicating components of acoustic feedback sound contained in the input signal acquired by the microphone 1 from reference signals of multiple blocks obtained by sequentially delaying the signal converted to the frequency domain by the FFT 421 on a block-by-block basis. The reference signals are, for example, output signals output to the speaker 3. The first to N-th frequency domain adaptive filters 431 to 43N estimate acoustic feedback characteristics for each of the multiple divided blocks. The acoustic feedback characteristics are filter coefficients. The first to N-th frequency domain adaptive filters 431 to 43N generate pseudo signals indicating components of acoustic feedback sound contained in the input signal by convolving, in the frequency domain, the filter coefficients generated for each of the multiple divided blocks and the reference signals delayed for each of the multiple divided blocks.

[0059] The sum calculation unit 44 calculates the sum of the pseudo signals for each divided block generated by the first to N-th frequency domain adaptive filters 431 to 43N.

[0060] The error calculation unit 45 calculates an error signal between the input signal obtained from the microphone 1 and the pseudo signal from the sum calculation unit 44, and outputs the calculated error signal to the first to N-th frequency domain adaptive filters 431 to 43N. The first to N-th frequency domain adaptive filters 431 to 43N update their filter coefficients based on the input error signal, and generate pseudo signals by convolving the updated filter coefficients with a reference signal. The first to N-th frequency domain adaptive filters 431 to 43N use a coefficient update algorithm (adaptive algorithm) to update the filter coefficients so as to minimize the error signal. Examples of the coefficient update algorithm include normalized LMS (Le a st Mean Square) is used.

[0061] Furthermore, the error calculation unit 45 cancels the acoustic feedback sound from the input signal by subtracting the pseudo signal from the sum calculation unit 44 from the input signal from the microphone 1. Therefore, the error calculation unit 45 outputs the input signal from which the acoustic feedback sound has been canceled to the suppression unit 104.

[0062] Generally, in an adaptive filter corresponding to the acoustic feedback characteristics from a speaker to a microphone, the continuous delay time of the estimated acoustic feedback characteristics is several tens of milliseconds to several hundreds of milliseconds. Therefore, a filter coefficient corresponding to the continuous delay time is required, resulting in a large amount of calculation. Furthermore, in a public address system, speech and amplification occur in the same space. Therefore, when a speaker's voice is directly heard by a target audience, it is desirable for a feedback suppression device to prevent a time difference between the speaker's voice and the amplified sound. If there is a large time difference between the speaker's voice and the amplified sound, the speaker's voice and the amplified sound will sound separate to the target audience, making it very difficult to hear and resulting in a problem of reduced clarity.

[0063] Therefore, in practice, a feedback suppression device needs to perform feedback suppression processing with low delay while minimizing the amount of calculation. As shown in FIG. 3, the MDF adaptive filter is composed of first to Nth frequency domain adaptive filters 431 to 43N divided into multiple blocks, and therefore can perform less calculation than a time domain adaptive filter. Furthermore, fast Fourier transform units 421 and 423 convert time domain data into frequency domain data using a relatively small number of samples, and inverse fast Fourier transform unit 422 converts frequency domain data into time domain data using a relatively small number of samples. Therefore, the MDF adaptive filter can shorten the processing delay. For example, if the sampling frequency is 16 kHz and the number of FFT samples is 128, FFT and IFFT are performed every 64 samples, resulting in a processing delay of 64 / 16 kHz = 4 ms, thereby achieving low delay.

[0064] Furthermore, in the MDF adaptive filter, the first to Nth frequency domain adaptive filters 431 to 43N estimate the acoustic feedback characteristic from the speaker 3 to the microphone 1 in the frequency domain for each divided block. Therefore, when the number of divided blocks is N, the estimation unit 102 can easily calculate the acoustic feedback amplitude-frequency characteristic ΣW′ from the filter coefficients W′1, . . . , W′N for the N divided blocks. Each filter coefficient W′* (* is 1, . . . , N) has the same frequency components as the number of FFT points, and ΣW′ is the acoustic feedback amplitude-frequency characteristic for each frequency component. The estimation unit 102 calculates a sum ΣW′ of the absolute values ​​of the multiple filter coefficients W′ estimated for each of the multiple divided blocks, and estimates the calculated sum ΣW′ as the acoustic feedback amplitude-frequency characteristic. For example, the estimation unit 102 calculates the acoustic feedback amplitude-frequency characteristic using the following equation (1):

[0065] ΣW'(i)=|W'1(i)|+|W'2(i)|+···+|W'N(i)|···(1) In the above equation (1), i represents the number of the frequency component (i=0, 1, 2, . . . , FFT point −1), and |*| represents the absolute value of the complex number *.

[0066] For example, if the sampling frequency is 16 kHz, the number of FFT points is 128, and the equivalent delay of the adaptive filter is 48 ms, the number of division blocks will be 12 (= 0.048 * 16,000 / 64). The sampling frequency is determined by the bandwidth of the audio. The number of FFT points determines the length of the overall processing delay. If the equivalent delay of the adaptive filter is long, the long delay will be eliminated, but the amount of calculation will increase. Therefore, the equivalent delay is determined by the amount of calculation and the audio level to be eliminated (for example, 30 dB).

[0067] FIG. 4 is a diagram showing an example of filter coefficients estimated in each of a plurality of divided blocks of an MDF adaptive filter and measured acoustic feedback characteristics.

[0068] 4 shows the estimated filter coefficients and measured acoustic feedback characteristics for the first to twelfth division blocks from the upper left to the lower right. The horizontal axis represents frequency, and the vertical axis represents the absolute values ​​of the filter coefficients and acoustic feedback characteristics. The dashed lines represent the absolute values ​​|W'1|, . . ., |W'12| of the filter coefficients estimated for each division block, and the solid lines represent the absolute values ​​|W1|, . . ., |W12| of the acoustic feedback characteristics from speaker 3 to microphone 1 measured in advance for each division block.

[0069] The estimation unit 102 calculates a sum ΣW′ of the absolute values ​​|W′ 1 |, . . . , |W′ 12 | of the filter coefficients estimated for each divided block in the adaptive filter unit 101 .

[0070] In the present embodiment, the estimation unit 102 calculates the sum of the absolute values ​​of all of the filter coefficients estimated for the multiple division blocks in the adaptive filter unit 101, but the present disclosure is not particularly limited to this, and the estimation unit 102 may calculate the sum of the absolute values ​​of some of the multiple filter coefficients estimated for the multiple division blocks in the adaptive filter unit 101. For example, as shown in FIG. 4, the filter coefficients of the ninth to twelfth division blocks are smaller than 0.1, and their contribution rates to acoustic feedback sound are low. Therefore, the estimation unit 102 may calculate the sum of the absolute values ​​of the filter coefficients estimated for the first to eighth division blocks without using the filter coefficients estimated for the ninth to twelfth division blocks.

[0071] Fig. 5 is a diagram showing an example of the acoustic feedback amplitude-frequency characteristic estimated by estimation unit 102 and the measured acoustic feedback amplitude-frequency characteristic. The horizontal axis represents frequency, and the vertical axis represents the acoustic feedback amplitude-frequency characteristic. The dashed line represents the acoustic feedback amplitude-frequency characteristic estimated by estimation unit 102, i.e., the sum ΣW' of the absolute values ​​of the filter coefficients of each divided block of the MDF adaptive filter, and the solid line represents the pre-measured acoustic feedback amplitude-frequency characteristic |W|. As shown in Fig. 5, the sum ΣW' of the absolute values ​​of the coefficients W'1, ..., W'12 of each divided block of the MDF adaptive filter is approximately equal to the pre-measured acoustic feedback amplitude-frequency characteristic |W|.

[0072] FIG. 6 is a block diagram showing a detailed configuration of the suppression gain calculation unit 103 shown in FIG.

[0073] The suppression gain calculation unit 103 calculates a suppression gain G from the acoustic feedback amplitude frequency characteristic estimated by the estimation unit 102, that is, the sum ΣW′ of a plurality of filter coefficients.

[0074] The suppression gain calculation unit 103 includes a smoothing processing unit 1031 , an average value calculation unit 1032 , and a gain calculation unit 1033 .

[0075] The smoothing processing unit 1031 calculates a smoothed value smthΣW′ by smoothing the input acoustic feedback amplitude frequency characteristic, that is, the sum ΣW′ of the absolute values ​​of a plurality of filter coefficients in the time direction.

[0076] The smoothing processor 1031 calculates a smoothing value smthΣW' of the input acoustic feedback amplitude frequency characteristic, i.e., the sum ΣW' of the absolute values ​​of a plurality of filter coefficients. If the sum ΣW'(i) is smaller than the smoothing value smthΣW'(i) (smthΣW'(i)>ΣW'(i)), the smoothing processor 1031 performs smoothing processing for each frequency component in accordance with the following equation (2).

[0077] smthΣW'(i)=(1-αdn)*smthΣW'(i)+αdn*ΣW'(i)...(2) Furthermore, when the sum ΣW'(i) is equal to or greater than the smoothing value smthΣW'(i) (smthΣW'(i)≦ΣW'(i)), the smoothing processing unit 1031 performs smoothing processing for each frequency component according to the following equation (3).

[0078] smthΣW'(i)=(1-αup)*smthΣW'(i)+αup*ΣW'(i)...(3) In the above equations (2) and (3), i represents the frequency component number (i=0, 1, 2, . . . , FFT point −1), αup represents the rising weighting coefficient, αdn represents the falling weighting coefficient, and αup is greater than αdn (αup>αdn).

[0079] The smoothing process acts as a peak hold because smthΣW' changes faster when ΣW' is greater than smthΣW' than when ΣW' is less than smthΣW'.

[0080] The average value calculation unit 1032 calculates the average value AVE of all frequencies of the smoothed value smthΣW′ calculated by the smoothing processing unit 1031.

[0081] FIG. 7 is a diagram showing an example of the smoothing value smthΣW′ calculated by the smoothing processing unit 1031 and the average value AVE calculated by the average value calculation unit 1032. As shown in FIG.

[0082] As shown in FIG. 7, the smoothing value smthΣW′ is obtained by smoothing the sum value ΣW′, and the average value AVE of all frequencies of the smoothing value smthΣW′ is, for example, 1.5.

[0083] The gain calculation unit 1033 divides the average value AVE of all frequencies calculated by the average value calculation unit 1032 by the smoothing value smthΣW′, clips the maximum value of the division result with an upper limit value Gmax, and clips the minimum value of the division result with a lower limit value Gmin, thereby calculating the suppression gain G. The upper limit value Gmax is, for example, 1, and the lower limit value Gmin is, for example, in the range of about 1 / 2 to 1 / 4 of the upper limit value Gmax.

[0084] FIG. 8 is a diagram showing an example of the suppression gain G calculated by the gain calculation unit 1033. As shown in FIG.

[0085] The suppression gain G calculated by the gain calculation unit 1033 satisfies Gmin≦G≦1. The lower limit value Gmin shown in Fig. 8 is, for example, 0.5. The reason why the minimum value of the suppression gain G is clipped at the lower limit value Gmin is to prevent deterioration of sound quality due to excessive suppression of the speaker's voice included in the output of the adaptive filter unit 101.

[0086] FIG. 9 is a block diagram showing a detailed configuration of the suppressing section 104 shown in FIG.

[0087] The suppression unit 104 includes a time-frequency conversion unit 1041 , a multiplication unit 1042 , and a frequency-time conversion unit 1043 .

[0088] The time-frequency transform unit 1041 transforms the output signal in the time domain output by the adaptive filter unit 101 into an output signal in the frequency domain.

[0089] The multiplier 1042 multiplies the output signal converted into the frequency domain by the suppression gain calculated by the suppression gain calculator 103 .

[0090] The frequency-time transform unit 1043 transforms the frequency domain output signal multiplied by the suppression gain by the multiplication unit 1042 into a time domain output signal. With the above configuration, it is possible to suppress peak components of the acoustic feedback characteristics in the frequency domain.

[0091] The time-frequency transform unit 1041 may perform a fast Fourier transform, and the frequency-time transform unit 1043 may perform an inverse fast Fourier transform. Furthermore, if the adaptive filter unit 101 is an MDF adaptive filter, the number of FFT points in the time-frequency transform unit 1041 and the frequency-time transform unit 1043 is preferably the same as the number of FFT points used in the MDF adaptive filter. This makes the number of frequency components in the output signal from the time-frequency transform unit 1041 the same as the number of frequency components in the suppression gain, allowing for efficient calculation.

[0092] If the adaptive filter unit 101 is an MDF adaptive filter, the first to N-th frequency domain adaptive filters 431 to 43N can set the filter update gain of each divided block individually.

[0093] FIG. 10 is a diagram showing an example of an acoustic feedback characteristic (time impulse response).

[0094] As shown in FIG. 10, the acoustic feedback characteristic includes a direct wave, a reflected wave, and a multiple reflected wave. The direct wave is output first, followed by the reflected wave and the multiple reflected wave. Therefore, the acoustic feedback characteristic decreases over time. Therefore, in response to the gradual decrease in the acoustic feedback characteristic as the divided block number increases, the first to Nth frequency domain adaptive filters 431 to 43N may be set to gradually decrease the filter update gain in the chronological order of the divided blocks. The filter update gain (coefficient update gain) of the coefficient update algorithm for each of the multiple divided blocks may decrease as the delay becomes longer. Setting the filter update gain in this manner can improve the convergence speed of the adaptive filter.

[0095] In this embodiment, the coefficient update algorithm (adaptation algorithm) of the first to Nth frequency domain adaptive filters 431 to 43N is normalized LMS, but the present disclosure is not particularly limited to this. The coefficient update algorithm may be LMS, independent component analysis, affine projection, recursive least squares (RLS), or other algorithms. In these algorithms, the convergence speed can be improved by setting a filter update gain in the same way as in normalized LMS.

[0096] Furthermore, the adaptive filter unit 101 may estimate acoustic feedback characteristics in the time domain instead of acoustic feedback characteristics in the frequency domain. In this case, the estimation unit 102 may convert the time domain acoustic feedback characteristics estimated by the adaptive filter unit 101 into acoustic feedback characteristics in the frequency domain, and estimate the acoustic feedback amplitude-frequency characteristic in the frequency domain. That is, when the adaptive filter unit 101 includes a time domain adaptive filter, the estimation unit 102 may convert the time domain filter coefficients into frequency domain filter coefficients, and estimate the sum Σ|W'| of the converted frequency domain filter coefficients as the acoustic feedback amplitude-frequency characteristic.

[0097] Next, the operation of the howling suppression device 100 according to the embodiment of the present disclosure will be described.

[0098] FIG. 11 is a flowchart illustrating the operation of the feedback suppression device 100 according to the embodiment of the present disclosure.

[0099] First, in step S1, the adaptive filter unit 101 estimates an acoustic feedback characteristic that represents the characteristic of the acoustic feedback sound input from the speaker 3 to the microphone 1, using the output signal output to the speaker 3 as a reference signal.

[0100] Next, in step S2, the adaptive filter unit 101 cancels the acoustic feedback sound from the input signal obtained from the microphone 1 using the estimated acoustic feedback characteristics.

[0101] Next, in step S3, the estimation unit 102 estimates the acoustic feedback amplitude-frequency characteristic in the frequency domain based on the acoustic feedback characteristic estimated by the adaptive filter unit 101.

[0102] Next, in step S4, the suppression gain calculation unit 103 calculates, from the acoustic feedback amplitude-frequency characteristic estimated by the estimation unit 102, a frequency domain suppression gain for flattening the frequency peak of the acoustic feedback amplitude-frequency characteristic.

[0103] Next, in step S5, the suppression unit 104 uses the suppression gain calculated by the suppression gain calculation unit 103 to suppress the output signal from the adaptive filter unit 101 in the frequency domain.

[0104] In this way, the adaptive filter unit 101 eliminates the acoustic feedback sound input from the speaker 3 to the microphone 1, and the suppression unit 104 suppresses the frequency peak components of the acoustic feedback amplitude-frequency characteristic, thereby enabling stable suppression of howling.

[0105] In each of the above embodiments, each component may be configured with dedicated hardware or may be realized by executing a software program suitable for that component. Each component may be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory. Furthermore, the program may be executed by another independent computer system by recording the program on a recording medium and transferring it, or by transferring the program via a network.

[0106] Some or all of the functions of the device according to the embodiments of the present disclosure are typically realized as an LSI (Large Scale Integration), which is an integrated circuit. These may be implemented individually on a single chip, or some or all of them may be integrated on a single chip. Furthermore, the integrated circuit is not limited to an LSI, and may be realized using a dedicated circuit or a general-purpose processor. It is also possible to use an FPGA (Field Programmable Gate Array), which can be programmed after LSI manufacturing, or a reconfigurable processor, which allows the connections and settings of circuit cells within the LSI to be reconfigured.

[0107] Furthermore, some or all of the functions of the device according to the embodiment of the present disclosure may be realized by a processor such as a CPU executing a program.

[0108] Furthermore, all the numbers used above are merely examples to specifically explain the present disclosure, and the present disclosure is not limited to the numbers used as examples.

[0109] The order in which the steps are performed shown in the above flowchart is merely an example for specifically explaining the present disclosure, and other orders may be used as long as similar effects are obtained. Also, some of the steps may be performed simultaneously (in parallel) with other steps. [Industrial Applicability]

[0110] The technology according to the present disclosure can stably suppress feedback, and is therefore useful as a technology for suppressing feedback that occurs due to acoustic feedback from a speaker to a microphone.

Claims

1. A howling suppression device that suppresses howling that occurs when sound picked up by a microphone is amplified by a speaker installed in the same space as the microphone, due to acoustic feedback from the speaker to the microphone, comprising: an adaptive filter unit that estimates acoustic feedback characteristics representing characteristics of acoustic feedback sound input from the speaker to the microphone using an output signal output to the speaker as a reference signal, and cancels the acoustic feedback sound from the input signal obtained from the microphone using the estimated acoustic feedback characteristics; an estimation unit that estimates an acoustic feedback amplitude-frequency characteristic in a frequency domain based on the estimated acoustic feedback characteristic; a suppression gain calculation unit that calculates a frequency domain suppression gain for flattening a frequency peak of the acoustic feedback amplitude frequency characteristic from the estimated acoustic feedback amplitude frequency characteristic; a suppression unit that suppresses an output signal from the adaptive filter unit in a frequency domain using the calculated suppression gain; A howling suppression device comprising:

2. the adaptive filter unit includes a frequency domain adaptive filter that estimates the acoustic feedback characteristic for each of a plurality of divided blocks.

2. The howling suppression device according to claim 1.

3. a coefficient update algorithm for each of the plurality of divided blocks is normalized LMS (Least Mean Square); 3. The howling suppressor according to claim 2.

4. a coefficient update algorithm for each of the plurality of divided blocks is independent component analysis; 3. The howling suppressor according to claim 2.

5. a coefficient update gain of the coefficient update algorithm for each of the plurality of divided blocks decreases as the delay increases; 5. A howling suppression device according to claim 3 or 4.

6. the acoustic feedback characteristic is a filter coefficient of the frequency domain adaptive filter; the estimation unit calculates a sum of the plurality of filter coefficients estimated for each of the plurality of divided blocks, and estimates the calculated sum as the acoustic feedback amplitude-frequency characteristic.

5. A howling suppression device according to claim 2.

7. the suppression gain calculation unit calculates the suppression gain by dividing an average value of the acoustic feedback amplitude-frequency characteristic estimated by the estimation unit by each acoustic feedback amplitude-frequency characteristic.

7. The howling suppressor according to claim 6.

8. the suppression gain calculation unit limits a maximum value of the suppression gain.

8. The howling suppression device according to claim 7.

9. the suppression gain calculation unit limits a minimum value of the suppression gain.

8. The howling suppression device according to claim 7.

10. the estimating unit converts the acoustic feedback characteristic in the time domain estimated by the adaptive filter unit into the acoustic feedback characteristic in the frequency domain, and estimates the acoustic feedback amplitude-frequency characteristic in the frequency domain.

2. The howling suppression device according to claim 1.

11. A feedback suppression method for a feedback suppression device that suppresses feedback that occurs when sound picked up by a microphone is amplified by a speaker installed in the same space as the microphone due to acoustic feedback from the speaker to the microphone, comprising: an adaptive filter unit estimates an acoustic feedback characteristic representing a characteristic of an acoustic feedback sound input from the speaker to the microphone using an output signal output to the speaker as a reference signal, and cancels the acoustic feedback sound from the input signal obtained from the microphone using the estimated acoustic feedback characteristic; an estimation unit estimating an acoustic feedback amplitude-frequency characteristic in a frequency domain based on the estimated acoustic feedback characteristic; a suppression gain calculation unit calculates, from the estimated acoustic feedback amplitude-frequency characteristic, a frequency domain suppression gain for flattening a frequency peak of the acoustic feedback amplitude-frequency characteristic; a suppression unit that suppresses the output signal from the adaptive filter unit in the frequency domain using the calculated suppression gain; Feedback suppression method.

12. A howling suppression program for suppressing howling that occurs when sound picked up by a microphone is amplified by a speaker installed in the same space as the microphone due to acoustic feedback from the speaker to the microphone, comprising: an adaptive filter unit that estimates acoustic feedback characteristics representing characteristics of acoustic feedback sound input from the speaker to the microphone using an output signal output to the speaker as a reference signal, and cancels the acoustic feedback sound from the input signal obtained from the microphone using the estimated acoustic feedback characteristics; an estimation unit that estimates an acoustic feedback amplitude-frequency characteristic in a frequency domain based on the estimated acoustic feedback characteristic; a suppression gain calculation unit that calculates a frequency domain suppression gain for flattening a frequency peak of the acoustic feedback amplitude frequency characteristic from the estimated acoustic feedback amplitude frequency characteristic; causing the computer to function as a suppression unit that suppresses the output signal from the adaptive filter unit in the frequency domain using the calculated suppression gain; Feedback suppression program.

Images