Acoustic system and signal processing method

By using signal processing methods of modulation and filtering operations in the acoustic system, the howling problem caused by acoustic feedback is solved, and the maximum sound gain of the acoustic system is improved.

WO2024239320A1PCT designated stage expired Publication Date: 2024-11-28SHENZHEN SHOKZ CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2023/096290
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-25
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

There are acoustic feedback problems in the acoustic system, which lead to problems such as howling and limits the maximum sound gain.

Method used

Using an acoustic system and signal processing method, including pronunciation components, sound pickup components and signal processing circuits, reduce feedback sound components in the sound pickup signal through modulation operations and filtering operations, enhance the convergence performance of the filtering operation to reduce or eliminate feedback sound .

Benefits of technology

Effectively reduce or eliminate feedback sound, avoid whistling problems, and improve the maximum sound gain of the acoustic system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2023096290_28112024_PF_FP_ABST
    Figure CN2023096290_28112024_PF_FP_ABST
Patent Text Reader

Abstract

The present description provides an acoustic system and a signal processing method. In the acoustic system, a sound producing assembly converts a driving signal into first sound when working; a pickup assembly picks up ambient sound and generates a pickup signal when working, wherein the ambient sound comprises the first sound and second sound from a target sound source; a signal processing circuit, when working, executes a target operation on the basis of the driving signal and the pickup signal to generate a first target signal, and sends the first target signal to the sound producing assembly, wherein the target operation at least comprises a modulation operation and a filtering operation, the filtering operation reduces a signal component corresponding to the first sound in the pickup signal, and the modulation operation reduces the effect of a nonlinear response component in a target response feature of the acoustic system on the convergence performance of the filtering operation. The solution can reduce or eliminate feedback sound, avoid the problems of howling and the like in the acoustic system, and improve the maximum sound gain of the acoustic system.
Need to check novelty before this filing date? Find Prior Art

Description

Acoustic system and signal processing method Technical Field

[0001] This specification relates to the field of acoustic technology, and in particular to an acoustic system and a signal processing method. Background Art

[0002] Some acoustic systems include both a sound-producing component (such as a speaker, etc.) and a sound-collecting component (such as a sound sensor, etc.). These acoustic systems usually have the problem of acoustic feedback. Among them, acoustic feedback means that the sound signal collected by the sound-collecting component is played through the sound-producing component after a certain processing, and the sound emitted by the sound-producing component is re-collected by the sound-collecting component, so that the acoustic system forms a closed loop of "sound-producing component->sound-collecting component->sound-producing component". In the above-mentioned acoustic system, the sound from the sound-producing component picked up by the sound-collecting component can be called feedback sound. The existence of feedback sound causes some problems in the acoustic system. For example, it causes problems such as howling in the acoustic system, and may also restrict the maximum sound gain that the acoustic system can achieve. Therefore, it is necessary to provide an acoustic solution that can reduce or eliminate feedback sound.

[0003] Summary of the Invention

[0004] This specification provides an acoustic system and a signal processing method that can reduce or eliminate feedback sound, thereby avoiding problems such as howling in the acoustic system and further improving the maximum sound gain that can be achieved by the acoustic system.

[0005] In a first aspect, the present specification provides an acoustic system comprising: a sound-producing component, a sound-collecting component, and a signal processing circuit; wherein, when the sound-producing component is in operation, it converts a driving signal into a first sound; when the sound-collecting component is in operation, it collects ambient sound and generates a sound-collecting signal; the ambient sound includes the first sound and a second sound from a target sound source; the signal processing circuit is connected to the sound-producing component and the sound-collecting component; when in operation, it performs a target operation based on the driving signal and the sound-collecting signal, generates a first target signal, and sends the first target signal as the driving signal to the sound-producing component; wherein the target operation comprises at least a modulation operation and a filtering operation; the filtering operation reduces the signal component corresponding to the first sound in the sound-collecting signal; the modulation operation reduces the influence of the nonlinear response component in the target response characteristic of the acoustic system on the convergence performance of the filtering operation.

[0006] In some embodiments, the sound-producing component includes a speaker and a first peripheral circuit, the first peripheral circuit is connected to the speaker and the signal processing circuit, and includes at least one first peripheral device; the sound-picking component includes a sound sensor and a second peripheral circuit, the second peripheral circuit is connected to the sound sensor and the signal processing circuit, and includes at least one second peripheral device; and the target response characteristic characterizes the response characteristic of at least one target device, the at least one target device including at least one device among the speaker, the sound sensor, the at least one first peripheral device, and the at least one second peripheral device.

[0007] In some embodiments, the target response characteristic includes at least M nonlinear response components, where M is an integer greater than or equal to 1; and the modulation operation is configured to modulate the to-be-modulated signal by simulating the M nonlinear response components.

[0008] In some embodiments, the target operation further includes a gain amplification operation. When the signal processing circuit performs the target operation: the modulation operation is performed on the drive signal as the signal to be modulated to obtain a modulated signal; based on the modulated signal, the filtering operation is performed on the picked-up signal to obtain a residual signal; and the gain amplification operation is performed on the residual signal to obtain the first target signal.

[0009] In some embodiments, after obtaining the first target signal, the signal processing circuit further: performs the modulation operation on the first target signal to obtain a second target signal; and updates the parameters of the filtering operation based on the second target signal to make the filtering operation converge.

[0010] In some embodiments, the M nonlinear response components come from N target devices in the acoustic system, where N is an integer greater than or equal to 1; and the modulation operation is configured to simulate the M nonlinear response components through a target response model, wherein the target response model is obtained by measuring the response data of the N target devices and jointly modeling the response data of the N target devices, or the target response model includes N sub-response models corresponding to the N target devices, wherein the i-th sub-response model is obtained by measuring the response data of the i-th target device and modeling the response data of the i-th target device, and i is a positive integer less than or equal to N.

[0011] In some embodiments, the target response characteristic includes a linear characteristic, which corresponds to a linear response interval of N target devices in the acoustic system, where N is an integer greater than or equal to 1; and the modulation operation is configured to modulate the signal to be modulated based on the linear characteristic so that the modulated signal corresponds to the linear response interval.

[0012] In some embodiments, the target operation also includes a gain amplification operation. When the signal processing circuit performs the target operation: based on the drive signal, the filtering operation is performed on the picked-up signal to obtain a residual signal; the gain amplification operation is performed on the residual signal to obtain an amplified signal; and the modulation operation is performed on the amplified signal as the signal to be modulated to obtain the first target signal.

[0013] In some embodiments, the target operation also includes a gain amplification operation. When the signal processing circuit performs the target operation: based on the drive signal, the filtering operation is performed on the picked-up signal to obtain a residual signal; the modulation operation is performed on the residual signal as the signal to be modulated to obtain a modulated signal; and the gain amplification operation is performed on the modulated signal to obtain the first target signal.

[0014] In some embodiments, after obtaining the first target signal, the signal processing circuit further: updates parameters of the filtering operation based on the first target signal to make the filtering operation converge.

[0015] In some embodiments, the linear feature is obtained by measuring the response data of the N target devices and jointly modeling the response data of the N target devices to obtain the linear feature; or, the linear feature is obtained by measuring the response data of the N target devices, modeling the response data of each target device separately to obtain N sub-signal features corresponding to the N target devices, and determining the linear feature based on the N sub-signal features.

[0016] In some embodiments, the filtering operation includes an adaptive filtering operation; and the modulation operation includes at least one of amplitude modulation, phase modulation, frequency modulation, and filter modulation.

[0017] In a second aspect, the present specification also provides a signal processing method, comprising: obtaining a driving signal, wherein the driving signal is a signal for driving a sound-generating component in the acoustic system to emit a first sound; obtaining a pickup signal, wherein the pickup signal is obtained by the sound-generating component in the acoustic system picking up ambient sound, wherein the ambient sound includes the first sound and a second sound from a target sound source; and performing a target operation based on the driving signal and the pickup signal to generate a first target signal, and sending the first target signal as the driving signal to the sound-generating component, wherein the target operation comprises a modulation operation and a filtering operation, wherein the filtering operation reduces the signal component corresponding to the first sound in the pickup signal, and the modulation operation reduces the influence of the nonlinear response component in the target response characteristic of the acoustic system on the convergence performance of the filtering operation.

[0018] In some embodiments, the sound-producing component includes a speaker and a first peripheral circuit, the first peripheral circuit includes at least one first peripheral device; the sound-picking component includes a sound sensor and a second peripheral circuit, the second peripheral circuit includes at least one second peripheral device; and the target response characteristic characterizes the response characteristic of at least one target device, the at least one target device including at least one device among the speaker, the sound sensor, the at least one first peripheral device and the at least one second peripheral device.

[0019] In some embodiments, the target response characteristic includes at least M nonlinear response components, where M is an integer greater than or equal to 1; and the modulation operation is configured to modulate the to-be-modulated signal by simulating the M nonlinear response components.

[0020] In some embodiments, the target operation further includes a gain amplification operation. The performing of the target operation based on the drive signal and the picked-up signal to generate a first target signal includes: performing the modulation operation on the drive signal as the signal to be modulated to obtain a modulated signal; performing the filtering operation on the picked-up signal based on the modulated signal to obtain a residual signal; and performing the gain amplification operation on the residual signal to obtain the first target signal.

[0021] In some embodiments, after obtaining the first target signal, the method further includes: performing the modulation operation on the first target signal to obtain a second target signal; and updating parameters of the filtering operation based on the second target signal to make the filtering operation converge.

[0022] In some embodiments, the M nonlinear response components come from N target devices in the acoustic system, where N is an integer greater than or equal to 1; and the modulation operation is configured to simulate the M nonlinear response components through a target response model, wherein the target response model is obtained by measuring the response data of the N target devices and jointly modeling the response data of the N target devices, or the target response model includes N sub-response models corresponding to the N target devices, wherein the i-th sub-response model is obtained by measuring the response data of the i-th target device and modeling the response data of the i-th target device, and i is a positive integer less than or equal to N.

[0023] In some embodiments, the target response characteristic includes a linear characteristic, which corresponds to a linear response interval of N target devices in the acoustic system, where N is an integer greater than or equal to 1; and the modulation operation is configured to modulate the signal to be modulated based on the linear characteristic so that the modulated signal corresponds to the linear response interval.

[0024] In some embodiments, the target operation further includes a gain amplification operation. The target operation is performed based on the drive signal and the picked-up signal to generate a first target signal, including: performing the filtering operation on the picked-up signal based on the drive signal to obtain a residual signal; performing the gain amplification operation on the residual signal to obtain an amplified signal; and performing the modulation operation on the amplified signal as the signal to be modulated to obtain the first target signal.

[0025] In some embodiments, the target operation further includes a gain amplification operation. The target operation is performed based on the drive signal and the picked-up signal to generate a first target signal, including: performing the filtering operation on the picked-up signal based on the drive signal to obtain a residual signal; performing the modulation operation on the residual signal as the signal to be modulated to obtain a modulated signal; and performing the gain amplification operation on the modulated signal to obtain the first target signal.

[0026] In some embodiments, after obtaining the first target signal, the method further includes: updating parameters of the filtering operation based on the first target signal to make the filtering operation converge.

[0027] In some embodiments, the linear feature is obtained by measuring the response data of the N target devices and jointly modeling the response data of the N target devices to obtain the linear feature; or, the linear feature is obtained by measuring the response data of the N target devices, modeling the response data of each target device separately to obtain N sub-signal features corresponding to the N target devices, and determining the linear feature based on the N sub-signal features.

[0028] In some embodiments, the filtering operation includes an adaptive filtering operation; and the modulation operation includes at least one of amplitude modulation, phase modulation, frequency modulation, and filter modulation.

[0029] As can be seen from the above technical solutions, the acoustic system and signal processing method provided in this specification are as follows: when the sound-producing component in the acoustic system is in operation, it converts the driving signal into a first sound; when the sound-collecting component is in operation, it collects ambient sound and generates a sound-collecting signal. The ambient sound includes the first sound and a second sound from a target sound source. The signal processing circuit is connected to the sound-producing component and the sound-collecting component. When in operation, it performs a target operation based on the driving signal and the sound-collecting signal to generate a first target signal, and sends the first target signal as the driving signal to the sound-producing component. The target operation includes at least a modulation operation and a filtering operation. Because the filtering operation reduces the signal component corresponding to the first sound in the sound-collecting signal, the solution provided in this specification can reduce or eliminate feedback sound, thereby avoiding problems such as howling caused by feedback sound, and helps to improve the maximum sound gain that can be achieved by the acoustic system. Furthermore, because the modulation operation reduces the influence of the nonlinear response component in the target response characteristic of the acoustic system on the convergence performance of the filtering operation, the solution provided in this specification can also improve the convergence performance of the filtering operation, thereby further improving the effect of canceling feedback sound.

[0030] Other functions of the acoustic system and signal processing method provided in this specification will be partially listed in the following description. The creative aspects of the acoustic system and signal processing method provided in this specification can be fully explained by practicing or using the methods, devices and combinations described in the following detailed examples. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the technical solutions in the embodiments of this specification, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0032] FIG1 is a schematic diagram showing an application scenario provided according to an embodiment of this specification;

[0033] FIG2 shows a schematic diagram of a design of an acoustic system provided according to an embodiment of this specification;

[0034] FIG3 shows another schematic diagram of a design of an acoustic system according to an embodiment of this specification;

[0035] FIG4 shows another schematic diagram of a design of an acoustic system according to an embodiment of this specification;

[0036] FIG5 shows another schematic diagram of a design of an acoustic system according to an embodiment of this specification;

[0037] FIG6 shows another schematic diagram of a design of an acoustic system according to an embodiment of this specification;

[0038] FIG7 shows a test result of filtering performance of an acoustic system provided according to an embodiment of this specification;

[0039] FIG8 shows a schematic diagram of a hardware structure of an acoustic system provided according to an embodiment of this specification; and

[0040] FIG9 is a schematic flow chart showing a signal processing method according to an embodiment of this specification. DETAILED DESCRIPTION

[0041] The following description provides specific application scenarios and requirements for this specification, with the goal of enabling those skilled in the art to make and use the contents of this specification. Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of this specification. Therefore, this specification is not limited to the embodiments shown, but is intended to be accorded the broadest scope consistent with the claims.

[0042] The terms used herein are for the purpose of describing specific example embodiments only and are not intended to be limiting. For example, as used herein, the singular forms "a," "an," and "the" may also include the plural forms unless the context clearly indicates otherwise. When used in this specification, the terms "comprise," "include," and / or "contain" are intended to refer to the presence of the associated integers, steps, operations, elements, and / or components, but do not preclude the presence of one or more other features, integers, steps, operations, elements, components, and / or groups or the addition of other features, integers, steps, operations, elements, components, and / or groups in the system / method.

[0043] These and other features of this specification, as well as the operation and function of the associated elements of the structure, and the economical assembly and manufacture of the components, can be significantly improved with consideration of the following description. Reference is made to the accompanying drawings, all of which form a part of this specification. However, it should be expressly understood that the drawings are for illustration and description purposes only and are not intended to limit the scope of this specification. It should also be understood that the drawings are not drawn to scale.

[0044] The flowcharts used in this specification illustrate operations implemented by systems according to some embodiments of the present specification. It should be clearly understood that the operations of the flowcharts may not be implemented in sequence. Rather, the operations may be implemented in reverse order or simultaneously. Furthermore, one or more additional operations may be added to the flowcharts. One or more operations may be removed from the flowcharts.

[0045] Before describing the specific embodiments of this specification, the following describes the application scenarios of this specification. The solution provided in this specification can be applied to scenarios where feedback sound needs to be reduced or eliminated. An example is provided below with reference to FIG1.

[0046] Figure 1 shows a schematic diagram of an application scenario provided according to an embodiment of this specification. As shown in Figure 1, application scenario 001 can be a sound amplification scenario, a hearing aid scenario, an assisted listening scenario, etc. In this scenario, the sound pickup component 120 collects ambient sound while in operation. In this specification, ambient sound refers to the sound in the environment, that is, ambient sound can include the sound emitted by all sound sources in the environment. During the sound pickup process by the sound pickup component 120, if both the sound generating component 110 and the target sound source 160 are emitting sound, the ambient sound collected by the sound pickup component 120 includes both the sound from the target sound source 160 and the sound from the sound generating component 110. Furthermore, the sound signal collected by the sound pickup component 120 is amplified by a gain (G) and then sent to the sound generating component 110, thereby driving the sound generating component 110 to produce sound. This forms a closed loop in the acoustic system: "sound generating component -> sound pickup component -> sound generating component." In this case, when sound signals of certain frequencies undergo self-oscillation, a howling phenomenon occurs. This howling can cause discomfort to the user, and when severe, it can also damage components in the acoustic system. In addition, the existence of the howling also brings limitations to the gain amplification factor of the acoustic system, thereby restricting the maximum sound gain that can be achieved by the acoustic system.

[0047] It should be noted that the application scenario shown in FIG1 is only part of the multiple application scenarios applicable to the embodiments of this specification. The acoustic system provided by the embodiments of this specification can also be applied to other similar scenarios, which are not listed one by one in this specification. Those skilled in the art should understand that the application of the solutions provided by the embodiments of this specification to other usage scenarios is also within the scope of protection of the embodiments of this specification.

[0048] In summary, the presence of feedback sound can cause a series of problems in the acoustic system, including but not limited to: generating howling and restricting the maximum acoustic gain that the acoustic system can achieve.

[0049] In some embodiments, the acoustic system may use acoustic feedback cancellation (AFC) technology to reduce or eliminate feedback sound. To facilitate subsequent description, the principle of AFC technology is first introduced below with reference to FIG2 .

[0050] FIG2 shows a schematic diagram of a design of an acoustic system according to an embodiment of this specification. The acoustic system 10 can be a hearing aid system, a secondary hearing system, or a sound amplification system. As shown in FIG2 , the acoustic system 10 can include a sound production component 110 , a sound pickup component 120 , and a signal processing circuit 150 .

[0051] Wherein, the pronunciation component 110 is a component with a pronunciation function. The pronunciation component 110 can be connected to the output port of the signal processing circuit 150, and when working, receives a driving signal from the signal processing circuit 150 and converts it into sound to play out. Continuing to refer to Figure 2, the pronunciation component 110 may include a loudspeaker 111 and a first peripheral circuit 112 (C1 is used to represent the first peripheral circuit in the accompanying drawings). Wherein, the loudspeaker 111 is a device for converting an electrical signal into sound, and may also be referred to as an electroacoustic converter. For example, the loudspeaker 111 may be a speaker. The first peripheral circuit 112 is connected between the output port of the signal processing circuit 150 and the loudspeaker 110. The first peripheral circuit 112 may refer to all circuits or part of the circuits between the output port of the signal processing circuit 150 and the loudspeaker 110. The first peripheral circuit 112 may perform some processing on the electrical signal output by the signal processing circuit 150 so that the processed electrical signal is suitable for playing by the loudspeaker 110. The first peripheral circuit 112 may include at least one first peripheral device, including but not limited to an operational amplifier device, a power amplifier device, a digital-to-analog converter device, a filter device, a tuning device, a capacitor, a resistor, an inductor, a chip, and other devices.

[0052] It should be noted that the speaker 111 can be a device that produces sound based on at least one conduction method among gas, liquid, and solid, and this specification does not limit this. The speaker 111 can be the speaker itself, or it can include the speaker and its accompanying simple circuit elements. The number of speakers 111 can be one or more. When the number of speakers 111 is multiple, the multiple speakers 111 can be arranged in an array. In addition, when the number of speakers 111 is multiple, the multiple speakers 111 can be connected to the signal processing circuit 150 through the same first peripheral circuit 112, or the multiple speakers 111 can also be connected to the signal processing circuit 150 through different first peripheral circuits 112.

[0053] The sound pickup component 120 is a component with a sound pickup function. The sound pickup component 120 can be connected to the input port of the signal processing circuit 150. When in operation, it picks up ambient sound to generate a sound pickup signal and sends the sound pickup signal to the signal processing circuit 150. Continuing with Figure 2, the sound pickup component 120 may include at least one sound sensor 121 and a second peripheral circuit 122 (C2 is used in the figure to represent the second peripheral circuit). The sound sensor 121 is a device for picking up sound and converting sound into an electrical signal, and may also be called an acoustic-to-electrical converter. For example, the sound sensor 121 may be a microphone (MIC). The second peripheral circuit 122 is connected between the sound sensor 121 and the input port of the signal processing circuit 150. The second peripheral circuit 122 may refer to all or part of the circuits between the sound sensor 121 and the input port of the signal processing circuit 150. The second peripheral circuit 122 may perform some processing on the electrical signal (i.e., the sound pickup signal) picked up by the sound sensor 121 in order to convert it into a signal suitable for processing by the signal processing circuit 150. The second peripheral circuit 122 may include at least one second peripheral device, which may include but is not limited to a power amplifier device, an operational amplifier device, an analog-to-digital converter device, a filter device, a tuning device, a capacitor, a resistor, an inductor, a chip, and other devices.

[0054] It should be noted that the sound sensor 121 can be a device that picks up sound based on at least one conductive method among gas, liquid, and solid, and this specification does not limit this. The sound sensor 121 can be the MIC itself, or it can include the MIC and its accompanying simple circuit elements. The number of sound sensors 121 can be one or more. When the number of sound sensors 121 is multiple, the multiple sound sensors 121 can be arranged in an array. In addition, when the number of sound sensors 121 is multiple, the multiple sound sensors 121 can be connected to the signal processing circuit 150 through the same second peripheral circuit 122, or the multiple sound sensors 121 can be connected to the signal processing circuit 150 through different second peripheral circuits 122.

[0055] Continuing with FIG2 , the acoustic system 10 operates as follows: the sound pickup component 120 collects ambient sound to generate a sound pickup signal y, and inputs the sound pickup signal y into the signal processing circuit 150. The ambient sound includes at least a second sound emitted by a target sound source 160. The target sound source 160 refers to a sound source other than the sound generating component 110. For example, the target sound source 160 may include an electronic device with a sound playback function (e.g., a television, a speaker, a mobile phone, etc.); or, as another example, the target sound source 160 may include a human throat. The sound pickup signal y may be referred to as the input signal of the signal processing circuit 150. The signal processing circuit 150 performs a series of processing on the sound pickup signal y to obtain a drive signal u, which is then sent to the sound generating component 110. The drive signal u may serve as the output signal of the signal processing circuit 150. The sound generating component 110 receives the drive signal u and converts it into a first sound. The first sound is re-collected by the sound sensor 120 after being transmitted through the feedback path. Therefore, the first sound may also be referred to as the feedback sound. Thus, the ambient sound collected by the sound pickup component 120 includes not only the second sound from the target sound source 160, but also the first sound from the sound generating component 110. In other words, the sound pickup signal y includes both the signal component x corresponding to the first sound (i.e., the feedback sound) and the signal component v corresponding to the second sound.

[0056] The signal processing circuit 150 can be a circuit with certain signal processing capabilities. The input port of the signal processing circuit 150 is connected to the sound pickup component 120, and the output port is connected to the sound production component 110. The signal processing circuit 150 can internally obtain a drive signal u and a sound pickup signal y from the sound pickup component 120. Furthermore, the signal processing circuit 150 performs a target operation based on the drive signal u and the sound pickup signal y to generate a first target signal, and transmits the first target signal as a new drive signal (i.e., the drive signal u at the next moment) to the sound production component 110.

[0057] The target operation includes at least a filtering operation. The filtering operation is configured to reduce the signal component corresponding to the first sound in the sound pickup signal y. In other words, the filtering operation can reduce the feedback component in the sound pickup signal y. The filtering operation may include an adaptive filtering operation. For example, the adaptive filtering operation may be a filtering operation based on AFC technology. The principle of the AFC-based filtering operation is described in detail below with reference to FIG2 .

[0058] Continuing with FIG2 , the signal processing circuit 150 may include a filtering unit 170 . The inputs to the filtering unit 170 include a drive signal u and a sound pickup signal y. Based on the drive signal u, the filtering unit 170 may reduce the signal component corresponding to the first sound in the sound pickup signal y, thereby obtaining a signal e. Specifically, assume that the acoustic transfer function between the speaker 111 and the sound sensor 121 is F. The filtering unit 170 may internally solve and adaptively update a time-varying transfer function F' to fit F. For purposes of distinction, the transfer function F' will be referred to as the predicted transfer function F', and F will be referred to as the true transfer function F. The filtering unit 170 uses the predicted transfer function F' to perform an adaptive filtering operation on the drive signal u to obtain a signal x', i.e., x'=u*F'. The signal x' can be considered a predicted value of the feedback component in the sound pickup signal y (i.e., the signal component corresponding to the first sound in the sound pickup signal y). Furthermore, the filtering unit 170 may subtract the signal x' from the sound pickup signal y to obtain a signal e, i.e., e=y-x'. The signal e obtained in this way contains no or less feedback sound components.

[0059] It should be noted that the filtering unit 170 can employ a variety of adaptive filtering algorithms when solving the prediction transfer function F', such as one or more of the least mean square (LMS), normalized least mean square (NLMS), and recursive least squares (RLS), etc., and the embodiments of this specification are not limited thereto. Furthermore, the adaptive filtering algorithm can be adaptive filtering in the time domain, frequency domain, or other transform domains.

[0060] The target operation may also include a gain amplification operation. Continuing with FIG2 , the signal processing circuit 150 may further include a gain amplification unit 130. The gain amplification unit 130 may perform a gain amplification operation on the signal e to generate a first target signal. The signal processing circuit 150 transmits the first target signal as the next-time driving signal u to the sounding component 110 to drive the sounding component 110 to produce sound.

[0061] According to the theory of adaptive filtering algorithm, the update method of the predicted transfer function F' can be achieved by minimizing the expectation of the mean square function of the signal e, that is: min F′ E[e 2 ]=min F′ E[(yu*F′) 2 ] Formula (1-1)

[0062] For example, taking the filter unit 170 using the LMS algorithm as an example, the above formula (1-1) is derived based on the gradient descent optimization method, and the update formula of the predicted transfer function F' can be obtained as follows: F'←F'+μ*e*u Formula (2-1)

[0063] Where μ is the iteration step size.

[0064] It should be understood that when the filtering unit 170 adopts algorithms such as NLMS, RLS, etc., a similar method can be used to derive an update formula for the prediction transfer function F', which will not be described one by one in this specification.

[0065] In summary, the acoustic system shown in FIG2 can reduce or eliminate feedback sound by performing an AFC-based filtering operation, thereby avoiding problems such as howling caused by feedback sound and helping to improve the maximum sound gain that can be achieved by the acoustic system.

[0066] According to signal processing theory, the closed-loop gain A of the acoustic system shown in Figure 2 can be expressed as follows:

[0067] According to the Nyquist stability criterion, an acoustic system must be able to cancel feedback if the predicted transfer function F' is exactly equal to the true transfer function F, that is, F' = F. When this requirement is met, the acoustic system is always stable, with no howling. Furthermore, the acoustic system can achieve infinite gain, that is, when G → ∞, A = G → ∞.

[0068] However, in actual acoustic systems, since the true transfer function F may be time-varying and the convergence process of the iterative solution may oscillate, it is difficult for the iterative process of F' to achieve the ideal condition F' = F. In other words, there is a certain deviation between the predicted transfer function F' obtained by the actual iteration and the true transfer function F. In this case, in order to maintain the stability of the acoustic system, the gain G provided by the gain amplifier unit 130 naturally cannot be infinite. The maximum gain that the acoustic system can achieve is:

[0069] As can be seen from formula (4), the deviation between the predicted transfer function F′ and the true transfer function F can be used to measure the convergence performance of the adaptive filtering algorithm, and thus the acoustic system's ability to cancel feedback sound. Specifically, the smaller the deviation between the predicted transfer function F′ and the true transfer function F, the better the convergence performance of the adaptive filtering algorithm, and thus the better the acoustic system's ability to cancel feedback sound. The larger the deviation between the predicted transfer function F′ and the true transfer function F, the worse the convergence performance of the adaptive filtering algorithm, and thus the worse the acoustic system's ability to cancel feedback sound.

[0070] In some embodiments, we can also use misalignment (MIS) to measure the convergence performance of the adaptive filtering algorithm. The misalignment MIS can be expressed as follows:

[0071] The unit of offset MIS is decibel (dB). When the predicted transfer function F' is initialized to zero, the offset MIS is 0dB. As the offset MIS decreases and approaches negative infinity, the deviation between the predicted transfer function F' and the true transfer function F decreases, indicating better convergence of the adaptive filtering algorithm and, consequently, better feedback cancellation by the acoustic system. As the offset MIS increases and approaches positive infinity, the deviation between the predicted transfer function F' and the true transfer function F increases, indicating worse convergence of the adaptive filtering algorithm and, consequently, worse feedback cancellation by the acoustic system.

[0072] It should be noted that the convergence performance of the adaptive filtering algorithm in the embodiments of this specification includes, but is not limited to, convergence speed, convergence error, etc. The convergence speed may refer to the speed at which the predicted transfer function F′ fits the true transfer function F, and the convergence error may refer to the deviation between the predicted transfer function F′ and the true transfer function F when the convergence condition is met.

[0073] In the acoustic system shown in Figure 2, the adaptive filtering algorithm is used to solve a time-varying predicted transfer function F′ to fit the actual transfer function F because the transfer effects of the sound-producing component 110 and the sound pickup component 120 are ignored. In other words, the sound-producing component 110 and the sound pickup component 120 are assumed to be ideal linear transducers. Specifically, the transfer function of the sound-producing component 110 is assumed to be 1 (or a constant k1), and the transfer function of the sound pickup component 120 is assumed to be 1 (or a constant k2). For simplicity, the following description will describe the transfer functions of ideal linear transducers as 1 without loss of generality.

[0074] However, in actual acoustic systems, the above assumptions are usually not true. The actual acoustic system is analyzed below. The transfer function of the sounding component 110 is recorded as F SPK, the transfer function of the pickup assembly 120 is recorded as F MIC At this time, the closed-loop gain A of the acoustic system shown in Figure 2 can be expressed as follows:

[0075] According to the Nyquist stability criterion, the requirement for the acoustic system to cancel the feedback sound is that the predicted transfer function F′ needs to be fitted with F SPK , F and F MIC The common transmission effect of these three, that is, F′=F SPK *F*F MIC .

[0076] In an actual acoustic system, the pickup assembly 120 typically includes a sound sensor 121 and a second peripheral circuit 122. The components in the sound sensor 121 and the second peripheral circuit 122 have a good linear response within the dynamic range of common audio signals. Therefore, according to signal processing theory, under the assumption of short-term stability, the transfer effect of the pickup assembly 120 can be approximately ignored. In other words, the transfer function F of the pickup assembly 120 is MIC It can be recorded as 1.

[0077] The sound generating component 110 generally includes a loudspeaker 111 and a first peripheral circuit 112. The interaction between the diaphragm and magnet of the loudspeaker 111 leads to hysteresis effects and saturation distortion, so the response of the loudspeaker 111 contains nonlinear response components. The first peripheral circuit 112 generally includes devices such as power amplifiers and operational amplifiers. The power amplifiers and operational amplifiers generally have limiting effects, so their responses also contain nonlinear response components. Similarly, other devices in the first peripheral circuit 112 may also have nonlinear response components. It can be seen that the transfer function F of the sound generating component 110 is SPK There are nonlinear response components.

[0078] In the scheme shown in FIG2 , since the filtering unit 170 obtains the driving signal u at a position before the output port of the signal processing circuit 150 and adaptively filters the driving signal u using the predicted transfer function F′, the transfer function F of the sounding component 110 is SPK The nonlinear response components in the prediction transfer function (F′) are inevitably introduced into the iterative solution of the prediction transfer function (PTF). Adaptive filtering algorithms are typically suitable for tracking time-varying linear systems. The introduction of these nonlinear response components can lead to poor convergence performance. For example, the prediction transfer function (PTF) may not converge, converge slowly, or have a large convergence error. This can deteriorate the acoustic system's misalignment indicator (MIS), further compromising the acoustic system's ability to counteract feedback sound.

[0079] To this end, the solution provided in the embodiments of this specification reduces the impact of the nonlinear response component on the convergence performance of the filtering operation by adding a modulation operation within the signal processing circuit 150. This will be described in detail below with reference to Figures 3 to 6.

[0080] FIG3 shows another schematic diagram of a design of an acoustic system according to an embodiment of the present specification. Referring to FIG3 , the signal processing circuit 150 may further include a modulation unit 180. The modulation unit 180 is configured to perform a modulation operation. In other words, the target operation performed by the signal processing circuit 150 includes a filtering operation, a modulation operation, and a gain amplification operation. It should be noted that the specific implementation of the filtering unit 170 and the gain amplification unit 130 can be found in the relevant description of FIG2 and will not be repeated here.

[0081] The modulation unit 180 may modulate the signal to reduce the influence of the nonlinear response component in the target response characteristic of the acoustic system on the convergence performance of the filtering operation.

[0082] Specifically, the target response characteristic can characterize the response characteristics of N target devices in the acoustic system, where N is an integer greater than or equal to 1. According to the foregoing description, the first peripheral circuit 112 may include at least one first peripheral device, and the second peripheral circuit 122 may include at least one second peripheral device. The N target devices may include the speaker 111, the sound sensor 121, the at least one first peripheral device, and at least one second peripheral device. In other words, the target response characteristic can characterize the response characteristics of at least one device among the speaker 111, the sound sensor 121, the at least one first peripheral device, and the at least one second peripheral device. It can be understood that when the value of N is greater than 1, the target response characteristic actually characterizes the response of the system when the N target devices are regarded as a system.

[0083] In the embodiments of this specification, the response characteristic of device A may refer to a characteristic that characterizes the relationship between the output signal and the input signal of device A. For example, assuming that the input signal of device A is denoted as S in , the output signal is recorded as S out , then it represents S out With S in The mathematical expression / model of the relationship between can be used as the response characteristic of device A. If the output signal S of device A out With the input signal S in If the output signal S of device A is linear, it means that device A has a linear response. out With the input signal S inWhen there is a nonlinear relationship between , it means that device A exhibits a nonlinear response. In some cases, the response characteristics of device A may include both linear response components and nonlinear response components. It should be noted that when the response characteristics of device A include nonlinear response components, the number of the nonlinear response components may be one or more. For example, assuming that the response characteristics of device A can be recorded as: S out =f1(S in )+f2(S in )+f3(S in ), where f1 is the linear response component, and f2 and f3 are the nonlinear response components, indicating that the response characteristics of device A include both the linear response component and two nonlinear response components.

[0084] Since the target response characteristic represents the response characteristics of N target devices, when the response characteristic of at least one target device among the N target devices includes a nonlinear response component, the target response characteristic also includes a nonlinear response component. It should be noted that the number of nonlinear response components included in the target response characteristic can be one or more. For ease of expression, in the following description, it is assumed that the target response characteristic includes M nonlinear response components, where M can be an integer greater than or equal to 1. It can be understood that in addition to the M nonlinear response components, the target response characteristic can also include a linear response component.

[0085] As previously mentioned, when a nonlinear response component exists in the response characteristics of at least one of the speaker 111, the sound sensor 121, the first peripheral circuit 112 (i.e., the at least one first peripheral device), and the second peripheral circuit 122 (i.e., the at least one second peripheral device), the nonlinear response component will affect the convergence performance of the filtering operation (e.g., an adaptive filtering operation based on AFC). Therefore, in the acoustic system shown in FIG3 , the modulation operation performed by the modulation unit 180 can be an operation of performing modulation based on the nonlinear response component in the target response characteristic. In this way, by performing the modulation operation, the modulation unit 180 can reduce the impact of the nonlinear response component on the convergence performance of the filtering operation, thereby improving the convergence performance of the filtering operation and further improving the effect of canceling feedback sound in the acoustic system.

[0086] In some embodiments, considering that the response characteristics of the sound sensor 121 and the second peripheral circuit 122 generally do not contain or contain relatively few nonlinear response components, while the response characteristics of the speaker 111 and the first peripheral circuit 112 generally contain or contain relatively many nonlinear response components, to simplify the implementation of the modulation unit 180, the target response characteristic may represent the response characteristics of the speaker 111, or the target response characteristic may represent the response characteristics of the at least one first peripheral device (e.g., a power amplifier, an operational amplifier, etc. in the first peripheral circuit 112), or the target response characteristic may represent the response characteristics of the speaker 111 and the at least one first peripheral device.

[0087] The modulation operation performed by the modulation unit 180 may include at least one of amplitude modulation, phase modulation, frequency modulation, and filter modulation.

[0088] Amplitude modulation refers to a method for modulating the amplitude of a signal. It should be noted that there are many ways to modulate the amplitude of a signal, and this specification does not limit this. For example, the amplitude of the modulated signal can be clipped to achieve modulation.

[0089] Phase modulation refers to a method of modulating the phase of a signal. It should be noted that there are many ways to modulate the phase of a signal, and this specification does not limit this. For example, the phase of the modulated signal can be changed to achieve modulation.

[0090] Frequency modulation refers to a method of modulating the frequency of a signal. It should be noted that there are many ways to modulate the frequency of a signal, and this specification does not limit this. For example, the frequency of the modulated signal can be changed to achieve modulation.

[0091] The filtering modulation refers to a method of achieving modulation by filtering a signal. It should be noted that there are many ways to filter a signal, and this specification does not limit this. For example, the signal to be modulated can be input into a preset filter to achieve modulation.

[0092] When performing the modulation operation, the modulation unit 180 may adopt one or more of amplitude modulation, phase modulation, frequency modulation, and filter modulation. When the modulation unit 180 adopts multiple modulation methods, the modulation method of the signal is more flexible and can meet the modulation requirements of different scenarios.

[0093] Based on the scheme shown in Figure 3, when designing the modulation operation performed by the modulation unit 180, the design can be carried out from different modulation principle dimensions. Two possible modulation principles are used as examples for illustration.

[0094] Modulation Principle 1: The modulation operation is configured to simulate the nonlinear response component in the target response characteristic.

[0095] Specifically, assuming that the target response characteristic includes at least M nonlinear response components, M is an integer greater than or equal to 1. When performing the modulation operation, the modulation unit 180 can modulate the to-be-modulated signal by simulating the M nonlinear response components.

[0096] The M nonlinear response components may originate from N target devices in the acoustic system. In other words, the M nonlinear response components are introduced by the N target devices, where N is an integer greater than or equal to 1. As previously mentioned, the N target devices may include at least one of the speaker 111, the sound sensor 121, the first peripheral circuit 112, and the second peripheral circuit 122. In this case, the nonlinear response of the N target devices can be pre-modeled to obtain a target response model. The target response model may be a mathematical expression used to characterize the nonlinear response of the N target devices. The mathematical expression may be in the form of a neural network, a function, or other possible forms. The target response model is used to replicate the nonlinear response of the N target devices. For example, assuming that signal S1 is input into the target response model to obtain signal S2, signal S2 can be considered "the result signal containing the M nonlinear response components obtained after the N target devices process signal S1."

[0097] When modeling the nonlinear responses of the N target devices, a joint modeling approach or a separate modeling approach may be used. The following introduces the two modeling approaches respectively.

[0098] (1) Joint modeling approach.

[0099] During the operation of the acoustic system, the response data of the N target devices can be measured. The response data of each target device may include output data corresponding to different values ​​of the input variables, wherein the input variables include but are not limited to: continuous working time, operating frequency, input signal amplitude, power supply voltage, temperature, humidity and other data. Furthermore, the response data of the N target devices are jointly modeled to obtain the target response model. Specifically, based on the response data of the N target devices, the deviation statistics of the response of the N target devices relative to the ideal linear component are analyzed and obtained. Among them, the deviation statistics may include but are not limited to statistics of at least one dimension of clipping distortion, harmonic distortion, difference frequency distortion, intermodulation distortion, repeatability, hysteresis, and resolution. Then, the response data whose deviation statistics exceed the preset threshold are modeled to obtain the target response model.

[0100] It should be understood that the target response model obtained by the joint modeling method simulates the nonlinear response of the N target devices under the joint action.

[0101] (2) Separate modeling method

[0102] During the operation of the acoustic system, the response data of the N target devices can be measured. Then, the response data of each target device is individually modeled to obtain a sub-response model corresponding to the target device. It should be understood that when performing individual modeling for each target device, the specific modeling method is similar to the joint modeling method and will not be described in detail here. The difference between the individual modeling method and the joint modeling method is that the individual modeling method models each target device individually, while the joint modeling method models the N target devices as a whole.

[0103] When using a separate modeling approach, a sub-response model can be generated for each target device. Therefore, in this case, the target response model actually includes N sub-response models corresponding to the N target devices. Each sub-response model simulates the nonlinear response of a single target device. Therefore, when using the target response model, the N sub-response models can be used in series to simulate the nonlinear response of the N target devices.

[0104] After modeling the target response model, the modulation unit 180 can simulate the M nonlinear response components using the target response model when performing the modulation operation, thereby modulating the signal to be modulated. Specifically, the modulation unit 180 can input the signal to be modulated into the target response model, and the target response model modulates the signal to be modulated and outputs a modulated signal.

[0105] Based on the modulation principle of the above modulation operation, the process of the signal processing circuit 150 performing the target operation is illustrated below with reference to FIG. 4 .

[0106] FIG4 shows another schematic diagram of an acoustic system according to an embodiment of the present specification. As shown in FIG4 , the modulation unit 180 may be located on the branch where the filtering unit 170 is located. In this case, the process of the signal processing circuit 150 performing the target operation is as follows:

[0107] (1) The signal processing circuit 150 outputs the driving signal u and obtains the sound pickup signal y from the sound pickup assembly 120 .

[0108] (2) The drive signal u is used as the signal to be modulated and the modulation operation is performed to obtain the modulated signal u′. For example, the drive signal u is input into the target response model to obtain the modulated signal u′. That is, u′=u*M.

[0109] Here, M represents the transfer function corresponding to the modulation operation, or in other words, M represents the target response model.

[0110] (3) Based on the modulated signal u′, the filtering operation is performed on the picked-up signal y to obtain the residual signal e.

[0111] Specifically, referring to FIG4 , adaptive filtering is performed on the modulated signal u′ using the prediction transfer function F′ to obtain a signal x′, i.e., x′ = u′*F′. Signal x′ can be considered a predicted value of the feedback component in the sound pickup signal y (i.e., the signal component in the sound pickup signal y corresponding to the first sound). Furthermore, signal x′ is subtracted from the sound pickup signal y to obtain a residual signal e. That is, e = yx′ = yu′*F′ = y - (u*M)*F′. The residual signal e thus obtained contains no or minimal feedback sound components.

[0112] (4) Performing the gain amplification operation on the residual signal e to obtain the first target signal (ie, the driving signal u at the next moment), ie, u=e*G.

[0113] The following describes the update method of the prediction transfer function F′ in the scheme shown in Figure 4. According to the theory of the adaptive filtering algorithm, the update method of the prediction transfer function F′ can be achieved by minimizing the expectation of the mean square function of the residual signal e, that is:

[0114] min F′ E[e 2 ]=min F′ E[(y-(u*M)*F′) 2 ] Formula (1-2)

[0115] Still taking the LMS algorithm adopted by the filtering unit 170 as an example, the above formula (1-2) is derived based on the optimization method of gradient descent, and the update formula of the prediction transfer function F′ can be obtained as follows:

[0116] F′←F′+μ*e*(u*M) formula (2-2)

[0117] Thus, after obtaining the first target signal u, the signal processing circuit 150 can further perform the modulation operation on the first target signal u to obtain a second target signal (i.e., u*M). Furthermore, according to the above formula (2-2), the predicted transfer function F′ is updated based on the second target signal (i.e., the parameters of the filtering operation are updated) to achieve convergence of the filtering operation.

[0118] In the scheme shown in FIG4 , the modulation unit 180 performs the modulation operation, which is equivalent to simulating the "nonlinear response process of the N target devices to the driving signal u." It can be understood that when the N target devices include all devices in the sound generating assembly 110 and the sound pickup assembly 120, the modulation operation simulates all nonlinear response components in the feedback path, and the predicted transfer function F′ is only responsible for tracking the linear response components in the feedback path. When the N target devices include some devices in the sound generating assembly 110 and the sound pickup assembly 120, the modulation operation simulates at least some nonlinear response components in the feedback path, and the predicted transfer function F′ is responsible for tracking both the linear response components and the remaining nonlinear response components in the feedback path. Therefore, the solution of the predicted transfer function F′ does not introduce any or introduces fewer nonlinear response components, thereby improving the convergence performance of the filtering operation and, in turn, improving the effect of canceling the feedback sound.

[0119] It should be noted that in the solution shown in FIG. 4 , when the modulation unit 180 performs the modulation operation, the target response model simulates the nonlinear response component in the target response characteristic. In some cases, the target response characteristic may also contain a linear response component in addition to the nonlinear response component. The target response model may or may not simulate the linear response component.

[0120] When the target response model does not simulate the linear response component, the linear response component will be fitted into the predicted transfer function F′ together with the acoustic transfer function F. That is, the predicted transfer function F′ ultimately fits the combined effect of the transfer function F and the linear response component.

[0121] In the case where the target response model simulates the linear response component, it is assumed that the modulation operation fully simulates the transfer function F of the pronunciation component 110 SPK and the transfer function F of the pickup assembly 120 MIC , that is, M=F SPK *F MIC In this case, the closed-loop gain A of the acoustic system can be expressed as follows:

[0122] From formula (3-4), it can be seen that the predicted transfer function F′ ultimately fits the acoustic transfer function F between the speaker 111 and the sound sensor 121. In this way, the influence of the predicted transfer function F′ on F SPK and F MIC Tracking pressure.

[0123] Modulation Principle 2: The modulation operation is configured to modulate the signal to be modulated so that the modulated signal operates in the linear response range of the target device.

[0124] The following uses device A as an example to illustrate the meaning of the linear response interval. Assuming device A is an ideal linear device, it exhibits a linear response to any input variable (such as time, frequency, amplitude, phase, temperature, humidity, etc.). However, in actual acoustic scenarios, this ideal assumption is often not met, and device A typically exhibits a linear response only under certain conditions. For example, when input variable X1 is in the first interval, device A exhibits a linear response, and when input variable X1 is in other intervals, device A exhibits a nonlinear response. In this case, the first interval of input variable X1 can be used as the linear response interval of device A. For another example, when input variable X2 is in the second interval, device A exhibits a linear response, and when input variable X2 is in other intervals, device A exhibits a nonlinear response. In this case, the second interval of input variable X2 can also be used as the linear response interval of device A. It should be noted that in actual application scenarios, for device A, the linear response intervals corresponding to different input variables may be the same or different.

[0125] The target response characteristic may include a linear characteristic. The linear characteristic corresponds to the linear response interval of N target devices in the acoustic system, where N is an integer greater than or equal to 1. As previously mentioned, the N target devices may include at least one of the speaker 111, the sound sensor 121, the first peripheral circuit 112, and the second peripheral circuit 122. The phrase "the linear characteristic corresponds to the linear response interval of the N target devices in the acoustic system" means that when a signal satisfies the linear characteristic, the N target devices will exhibit a linear response when processing the signal, or in other words, the N target devices will operate in a linear response mode. The linear characteristic may include a numerical interval corresponding to at least one input variable. For example, the linear characteristic may include at least one numerical interval selected from the amplitude interval [A1, A2], the frequency interval [f1, f2], the phase interval [w1, w2], the temperature interval [t1, t2], the humidity interval [H1, H2], and the time interval [T1, T2].

[0126] The linear characteristics can be obtained by pre-modeling the linear response of the N target devices. A joint modeling approach or a separate modeling approach can be used for modeling. The two modeling approaches are described below.

[0127] (1) Joint modeling approach.

[0128] During the operation of the acoustic system, the response data of the N target devices can be measured. The response data of each target device may include output data corresponding to different values ​​of the input variables, wherein the input variables include but are not limited to: continuous working time, operating frequency, input signal amplitude, power supply voltage, temperature, humidity and other data. Furthermore, the response data of the N target devices are jointly modeled to obtain the linear characteristics. Specifically, based on the response data of the N target devices, the deviation statistics of the response of the N target devices relative to the ideal linear component when the values ​​of the input variables are in different intervals are analyzed. The deviation statistics may include but are not limited to statistics of at least one dimension of clipping distortion, harmonic distortion, difference frequency distortion, intermodulation distortion, repeatability, hysteresis, and resolution. For example, when the amplitude is in the interval [A1, A2] and the frequency is in the interval [f1, f2], the deviation statistics of the response of the N target devices relative to the ideal linear component are less than a preset threshold. In this case, the linear features obtained by modeling include: an amplitude interval [A1, A2] and a frequency interval [f1, f2].

[0129] It should be understood that the linear characteristics obtained by the joint modeling approach take into account the linear response of the N target devices under the joint action. In other words, when a signal satisfies the linear characteristics, the signal will cause the N target devices to operate in a linear response mode.

[0130] (2) Separate modeling method.

[0131] During the operation of the acoustic system, the response data of the N target devices can be measured. Then, the response data of each target device is modeled separately to obtain the sub-signal characteristics corresponding to the target device, so that N sub-signal characteristics corresponding to the N target devices can be obtained. Each sub-signal characteristic includes a numerical interval corresponding to at least one input variable. It should be understood that when modeling each target device separately, the specific modeling method is similar to the joint modeling method, which will not be described here. Furthermore, the linear feature can be determined based on the N sub-signal features. For example, the numerical intervals in the N sub-signal features can be subjected to intersection operations or other operations to obtain the linear feature.

[0132] After modeling and obtaining the linear characteristics, the modulation unit 180 can modulate the to-be-modulated signal based on the linear characteristics when performing the modulation operation, so that the modulated signal corresponds to the linear response range of the N target devices. In other words, the purpose of the modulation operation is to ensure that the modulated signal meets the numerical range specified by the linear characteristics. For example, the modulation unit 180 can use at least one of amplitude modulation, phase modulation, frequency modulation, and filter modulation to adjust the to-be-modulated signal so that the modulated signal meets the data range specified by the linear characteristics. In this way, when the modulated signal is processed by the N target devices, the N target devices will operate in a linear response mode and will not enter a nonlinear response mode.

[0133] Based on the modulation principle of the above modulation operation, the process of the signal processing circuit 150 performing the target operation is described below with reference to FIG. 5 and FIG. 6 .

[0134] FIG5 shows another design schematic diagram of an acoustic system according to an embodiment of the present specification. As shown in FIG5 , the modulation unit 180 can be located after the gain amplification unit 130 and before the extraction position of the drive signal u. In this case, the process of the signal processing circuit 150 performing the target operation is as follows:

[0135] (1) The signal processing circuit 150 obtains the driving signal u therein and obtains the sound pickup signal y from the sound pickup assembly 120 .

[0136] (2) Based on the driving signal u, the filtering operation is performed on the sound pickup signal y to obtain the residual signal e.

[0137] Specifically, referring to Figure 5 , adaptive filtering is performed on the drive signal u using the prediction transfer function F' to obtain a signal x', i.e., x' = u * F'. Signal x' can be considered a predicted value of the feedback component in the sound pickup signal y (i.e., the signal component in the sound pickup signal y corresponding to the first sound). Furthermore, signal x' is subtracted from the sound pickup signal y to obtain a residual signal e, i.e., e = yx' = yu * F'. The resulting residual signal e contains no or minimal feedback sound components.

[0138] (3) Perform the gain amplification operation on the residual signal e to obtain an amplified signal e′, that is, e′=e*G, where G represents the gain amplification factor.

[0139] (4) The amplified signal e′ is used as the signal to be modulated to perform the modulation operation to obtain the first target signal (ie, the driving signal u at the next moment), ie, u=e′*M. Wherein, M represents the transfer function corresponding to the modulation operation.

[0140] FIG6 shows another design schematic diagram of an acoustic system according to an embodiment of the present specification. As shown in FIG6 , the modulation unit 180 may be located before the gain amplification unit 130. In this case, the process of the signal processing circuit 150 performing the target operation is as follows:

[0141] (1) The signal processing circuit 150 obtains the driving signal u therein and obtains the sound pickup signal y from the sound pickup assembly 120 .

[0142] (2) Based on the driving signal u, the filtering operation is performed on the sound pickup signal y to obtain the residual signal e.

[0143] Specifically, referring to Figure 6 , adaptive filtering is performed on the drive signal u using the prediction transfer function F' to obtain a signal x', i.e., x' = u * F'. Signal x' can be considered a predicted value of the feedback component in the sound pickup signal y (i.e., the signal component in the sound pickup signal y corresponding to the first sound). Furthermore, signal x' is subtracted from the sound pickup signal y to obtain a residual signal e, i.e., e = yx' = yu * F'. The resulting residual signal e contains no or minimal feedback sound components.

[0144] (3) The residual signal e is used as the signal to be modulated to perform the modulation operation to obtain the modulated signal e′.

[0145] That is, e′=e*M, where M represents the transfer function corresponding to the modulation operation.

[0146] (4) Performing the gain amplification operation on the modulated signal e′ to obtain a first target signal (ie, the driving signal u at the next moment), ie, u=e′*G, where G represents the gain amplification factor.

[0147] Based on the schemes shown in FIG5 and FIG6, according to the theory of the adaptive filtering algorithm, the update method of the predicted transfer function F′ can be achieved by minimizing the expectation of the mean square function of the target signal e, that is: min F′ E[e 2 ]=min F′ E[(yu*F′) 2 ] Formula (1-1)

[0148] Still taking the LMS algorithm used in the filter unit 170 as an example, the above formula (1-2) is derived based on the gradient descent optimization method, and the update formula of the prediction transfer function F′ can be obtained as follows: F′←F′+μ*e*u Formula (2-1)

[0149] It can be seen that after obtaining the first target signal u, the signal processing circuit 150 can update the prediction transfer function F′ (i.e., update the parameters of the filtering operation) based on the first target signal u according to the above formula (2-2) to make the filtering operation converge.

[0150] In the schemes shown in Figures 5 and 6 , the signal processing circuit 150 performs the modulation operation so that the first target signal u output to the sounding component 110 always operates within the linear response range of the N target devices. It can be understood that when the N target devices include all devices in the sounding component 110 and the sound pickup component 120, all nonlinear response components in the feedback path are eliminated; when the N target devices include some devices in the sounding component 110 and the sound pickup component 120, the nonlinear response components in the feedback path are reduced. Therefore, in the schemes shown in Figures 5 and 6 , the solution of the predicted transfer function F′ does not introduce any or introduces fewer nonlinear response components, thereby improving the convergence performance of the filtering operation and, in turn, enhancing the feedback sound cancellation effect.

[0151] FIG7 shows the test results of the acoustic system provided according to the embodiment of this specification in terms of filtering performance. Referring to FIG7 , in the case where the speaker 111 in the acoustic system has a limiting characteristic, when the scheme shown in FIG2 is adopted, the calculated offset is shown as Curve A. When the scheme shown in FIG4 is adopted, the calculated offset is shown as Curve B. Among them, the calculation method of the offset has been described in the previous text and will not be repeated here. It can be seen from FIG7 that the convergence degree and convergence speed of the adaptive filtering algorithm are significantly improved by adopting the scheme shown in FIG4. It should be noted that FIG7 only illustrates the comparison of the test results of the schemes shown in FIG2 and FIG4 . The schemes shown in FIG5 and FIG6 also have a significant improvement in the convergence degree and convergence speed of the adaptive filtering algorithm compared to the scheme shown in FIG2 , which is not illustrated in the accompanying drawings.

[0152] The signal processing circuit 150 can be configured to perform the signal processing methods described in the embodiments of this specification. In some embodiments, the signal processing circuit 150 may include multiple hardware circuits in a connected relationship, each hardware circuit including one or more electrical components, and when operating, implement one or more steps of the signal processing methods described in the embodiments of this specification. For example, the filtering operation, the modulation operation, and the gain amplification operation can be implemented by different hardware circuits or different electrical components, respectively. When operating, the multiple hardware circuits described above cooperate with each other to implement the signal processing methods described in the embodiments of this specification. In some embodiments, the signal processing circuit 150 may also include a hardware device with data information processing functions and the necessary programs required to drive the hardware device to operate. The hardware device implements the signal processing methods described in the embodiments of this specification by executing the programs. The signal processing methods will be described in detail later.

[0153] FIG8 shows a schematic diagram of a hardware structure of an acoustic system provided according to an embodiment of the present specification. As shown in FIG8 , the signal processing circuit 150 may include: at least one storage medium 210 and at least one processor 220. The at least one processor 220 is communicatively connected with the pronunciation component 110 and the sound pickup component 120. It should be noted that, for the purpose of demonstration only, the signal processing circuit 150 in the embodiment of the present specification includes at least one storage medium 210 and at least one processor 220. It will be understood by those skilled in the art that the signal processing circuit 150 may also include other hardware circuit structures, which are not limited in the embodiments of the present specification, as long as they can meet the functions mentioned in the embodiments of the present specification without departing from the spirit of the embodiments of the present specification.

[0154] Continuing with FIG8 , in some embodiments, the acoustic system may further include a communication port 230. The communication port 230 is used for data communication between the acoustic system and the outside world. For example, the communication port 230 can be used for data communication between the acoustic system and other devices / systems. In some embodiments, the acoustic system may further include an internal communication bus 240. The internal communication bus 240 can connect different system components. For example, the sound generating component 110, the sound pickup component 120, the processor 220, the storage medium 210, and the communication port 230 can all be connected via the internal communication bus 240.

[0155] The storage medium 210 may include a data storage device. The data storage device may be a non-transitory storage medium or a temporary storage medium. For example, the data storage device may include one or more of a disk 2101, a read-only storage medium (ROM) 2102, or a random access storage medium (RAM) 2103. The storage medium 210 also includes at least one instruction set stored in the data storage device. The instruction set includes instructions, which are computer program codes. The computer program codes may include programs, routines, objects, components, data structures, processes, modules, etc. for executing the signal processing methods provided in the embodiments of this specification.

[0156] At least one processor 220 is used to execute the at least one instruction set mentioned above. When the acoustic system is running, at least one processor 220 reads the at least one instruction set and, according to the instructions of the at least one instruction set, executes the signal processing method provided by the embodiment of this specification. The processor 220 can perform all or part of the steps included in the above-mentioned signal processing method. The processor 220 can be in the form of one or more processors. In some embodiments, the processor 220 can include one or more hardware processors, such as a microcontroller, a microprocessor, a reduced instruction set computer (RISC), an application-specific integrated circuit (ASIC), an application-specific instruction set processor (ASIP), a central processing unit (CPU), a graphics processing unit (GPU), a physical processing unit (PPU), a microcontroller unit, a digital signal processor (DSP), a field programmable gate array (FPGA), an advanced RISC machine (ARM), a programmable logic device (PLD), any circuit or processor capable of performing one or more functions, etc., or any combination thereof. For illustration purposes only, the acoustic system shown in Figure 8 illustrates a case where only one processor 220 is included. However, it should be noted that the acoustic system provided in the embodiments of this specification may also include multiple processors. Therefore, the operations and / or method steps disclosed in the embodiments of this specification may be performed by a single processor or jointly by multiple processors. For example, if the processor 220 of the acoustic system in the embodiments of this specification performs step A and step B, it should be understood that step A and step B may also be performed jointly or separately by two different processors 220 (e.g., the first processor performs step A, the second processor performs step B, or the first and second processors perform steps A and B together).

[0157] FIG9 shows a flow chart of a signal processing method P100 provided according to an embodiment of the present specification. As previously described, the signal processing circuit 150 in the acoustic system can execute the signal processing method P100 of the present specification. Specifically, the processor 220 can read the instruction set stored in its local storage medium and then execute the signal processing method P100 of the present specification according to the provisions of the instruction set. As shown in FIG9 , the signal processing method P100 may include:

[0158] S10: Obtain a driving signal, where the driving signal is a signal for driving a sound-producing component in the acoustic system to emit a first sound.

[0159] S20: Obtaining a sound pickup signal, where the sound pickup signal is obtained by a sound pickup component in the acoustic system picking up ambient sound, and the ambient sound includes the first sound and a second sound from a target sound source.

[0160] It should be understood that the execution order of S10 and S20 can be arbitrary. For example, the signal processing circuit 150 can execute S10 first and then S20, or can execute S20 first and then S10, or can execute S10 and S20 in parallel.

[0161] S30: Execute a target operation based on the driving signal and the picked-up signal to generate a first target signal, and send the first target signal as the driving signal to the pronunciation component, wherein the target operation includes a modulation operation and a filtering operation, wherein the filtering operation reduces the signal component corresponding to the first sound in the picked-up signal, and the modulation operation reduces the influence of the nonlinear response component in the target response characteristic of the acoustic system on the convergence performance of the filtering operation.

[0162] In some embodiments, the sound-producing component includes: a speaker and a first peripheral circuit, the first peripheral circuit includes at least one first peripheral device; the sound-picking component includes: a sound sensor and a second peripheral circuit, the second peripheral circuit includes at least one second peripheral device; and the target response characteristic characterizes the response characteristic of at least one target device, the at least one target device includes at least one device among the speaker, the sound sensor, the at least one first peripheral device and the at least one second peripheral device.

[0163] In some embodiments, the target response characteristic includes at least M nonlinear response components, where M is an integer greater than or equal to 1; and the modulation operation is configured to modulate the to-be-modulated signal by simulating the M nonlinear response components.

[0164] In some embodiments, the target operation further includes a gain amplification operation. The performing of the target operation based on the drive signal and the picked-up signal to generate a first target signal includes: performing the modulation operation on the drive signal as the signal to be modulated to obtain a modulated signal; performing the filtering operation on the picked-up signal based on the modulated signal to obtain a residual signal; and performing the gain amplification operation on the residual signal to obtain the first target signal.

[0165] In some embodiments, after obtaining the first target signal, the method further includes: performing the modulation operation on the first target signal to obtain a second target signal; and updating parameters of the filtering operation based on the second target signal to make the filtering operation converge.

[0166] In some embodiments, the M nonlinear response components come from N target devices in the acoustic system, where N is an integer greater than or equal to 1; and the modulation operation is configured to simulate the M nonlinear response components through a target response model, wherein the target response model is obtained by measuring the response data of the N target devices and jointly modeling the response data of the N target devices, or the target response model includes N sub-response models corresponding to the N target devices, wherein the i-th sub-response model is obtained by measuring the response data of the i-th target device and modeling the response data of the i-th target device, and i is a positive integer less than or equal to N.

[0167] In some embodiments, the target response characteristic includes a linear characteristic, which corresponds to a linear response interval of N target devices in the acoustic system, where N is an integer greater than or equal to 1; and the modulation operation is configured to modulate the signal to be modulated based on the linear characteristic so that the modulated signal corresponds to the linear response interval.

[0168] In some embodiments, the target operation further includes a gain amplification operation. The target operation is performed based on the drive signal and the picked-up signal to generate a first target signal, including: performing the filtering operation on the picked-up signal based on the drive signal to obtain a residual signal; performing the gain amplification operation on the residual signal to obtain an amplified signal; and performing the modulation operation on the amplified signal as the signal to be modulated to obtain the first target signal.

[0169] In some embodiments, the target operation further includes a gain amplification operation. The target operation is performed based on the drive signal and the picked-up signal to generate a first target signal, including: performing the filtering operation on the picked-up signal based on the drive signal to obtain a residual signal; performing the modulation operation on the residual signal as the signal to be modulated to obtain a modulated signal; and performing the gain amplification operation on the modulated signal to obtain the first target signal.

[0170] In some embodiments, after obtaining the first target signal, the method further includes: updating parameters of the filtering operation based on the first target signal to make the filtering operation converge.

[0171] In some embodiments, the linear feature is obtained by measuring the response data of the N target devices and jointly modeling the response data of the N target devices to obtain the linear feature; or, the linear feature is obtained by measuring the response data of the N target devices, modeling the response data of each target device separately to obtain N sub-signal features corresponding to the N target devices, and determining the linear feature based on the N sub-signal features.

[0172] In some embodiments, the filtering operation includes an adaptive filtering operation; and the modulation operation includes at least one of amplitude modulation, phase modulation, frequency modulation, and filter modulation.

[0173] It should be noted that the detailed implementation of the signal processing method P100 can be found in the relevant description of the acoustic system above. Its implementation principle and technical effects are similar and will not be repeated here.

[0174] In summary, in the solution provided by this specification, the sound-producing component in the acoustic system converts the driving signal into a first sound when in operation, and the sound pickup component picks up ambient sound and generates a sound pickup signal when in operation. The ambient sound includes the first sound and a second sound from a target sound source. The signal processing circuit is connected to the sound-producing component and the sound pickup component. When in operation, the signal processing circuit performs a target operation based on the driving signal and the sound pickup signal to generate a first target signal, and transmits the first target signal as the driving signal to the sound-producing component. The target operation includes at least a modulation operation and a filtering operation. Because the filtering operation reduces the signal component corresponding to the first sound in the sound pickup signal, the solution provided by this specification can reduce or eliminate feedback sound, thereby avoiding problems such as howling caused by feedback sound, and helps to improve the maximum sound gain that can be achieved by the acoustic system. Furthermore, because the modulation operation reduces the influence of the nonlinear response component in the target response characteristic of the acoustic system on the convergence performance of the filtering operation, the solution provided by this specification can also improve the convergence performance of the filtering operation, thereby further improving the effect of canceling feedback sound.

[0175] On the other hand, this specification provides a non-transitory storage medium that stores at least one set of executable instructions for performing signal processing. When the executable instructions are executed by a processor, the executable instructions instruct the processor to implement the steps of the signal processing method P100 described in this specification. In some possible implementations, various aspects of this specification can also be implemented in the form of a program product, which includes program code. When the program product is run on an acoustic system, the program code is used to cause the acoustic system to perform the steps of the signal processing method P100 described in this specification. The program product for implementing the above method can use a portable compact disc read-only memory (CD-ROM) to include program code and can be run on the acoustic system. However, the program product of this specification is not limited to this. In this specification, a readable storage medium can be any tangible medium that contains or stores a program that can be used by an instruction execution system or used in combination with it. The program product can use any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media include: an electrical connection having one or more conductors, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. The computer-readable storage medium may include a data signal propagated in baseband or as part of a carrier wave, which carries readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable storage medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transfer a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing. Program code for carrying out the operations described herein may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may execute entirely on the acoustic system, partially on the acoustic system, as a stand-alone software package, partially on the acoustic system and partially on a remote computing device, or entirely on the remote computing device.

[0176] The foregoing description of this specification describes specific embodiments. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that described in the embodiments and still achieve the desired results. Furthermore, the processes depicted in the accompanying drawings do not necessarily require the particular order or sequential order shown to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0177] In summary, after reading this detailed disclosure, those skilled in the art will appreciate that the foregoing detailed disclosure may be presented by way of example only and may not be limiting. Although not expressly stated herein, those skilled in the art will understand that this specification encompasses various reasonable changes, improvements, and modifications to the embodiments. Such changes, improvements, and modifications are intended to be suggested by this specification and are within the spirit and scope of the exemplary embodiments of this specification.

[0178] Furthermore, certain terms in this specification have been used to describe embodiments of this specification. For example, “one embodiment,” “an embodiment,” and / or “some embodiments” mean that a particular feature, structure, or characteristic described in connection with that embodiment may be included in at least one embodiment of this specification. Therefore, it is emphasized and should be understood that two or more references to “an embodiment,” “one embodiment,” or “an alternative embodiment” in various parts of this specification do not necessarily refer to the same embodiment. Furthermore, particular features, structures, or characteristics may be appropriately combined in one or more embodiments of this specification.

[0179] It should be understood that in the foregoing descriptions of the embodiments of this specification, to facilitate understanding of a feature and to simplify this specification, various features are combined in a single embodiment, figure, or description thereof. However, this does not necessarily mean that these features are combined. When reading this specification, a person skilled in the art may label some of the devices as separate embodiments. In other words, the embodiments of this specification can also be understood as the integration of multiple sub-embodiments. This also applies when each sub-embodiment contains fewer than all the features of a single previously disclosed embodiment.

[0180] Each patent, patent application, patent application publication, and other materials, such as articles, books, specifications, publications, documents, articles, and the like, cited herein, except any historical prosecution documents to which it relates, any equivalent that may be inconsistent or conflicting with this document, or any equivalent historical prosecution documents that may have a limiting effect on the broadest scope of the claims, is hereby incorporated by reference for all purposes now or hereafter connected with this document. In addition, in the event of any inconsistency or conflict between the descriptions, definitions, and / or use of terms associated with any incorporated material and the terminology, descriptions, definitions, and / or use associated with this document, the terminology in this document shall control.

[0181] Finally, it should be understood that the embodiments of the application disclosed herein are illustrative of the principles of the embodiments of this specification. Other modified embodiments are also within the scope of this specification. Therefore, the embodiments disclosed in this specification are merely examples and not limitations. Those skilled in the art can adopt alternative configurations based on the embodiments in this specification to implement the application in this specification. Therefore, the embodiments of this specification are not limited to the embodiments precisely described in the application.

Claims

1. An acoustic system, characterized in that: include: A sound producing component, which converts a driving signal into a first sound when in operation; A sound pickup component, which picks up ambient sound and generates a sound pickup signal when in operation, wherein the ambient sound includes the first sound and a second sound from a target sound source; as well as The signal processing circuit is connected to the sound producing component and the sound pickup component, and when in operation: performing a target operation based on the drive signal and the picked-up sound signal to generate a first target signal, and The first target signal is sent to the sound generating component as the driving signal, wherein The target operation includes at least a modulation operation and a filtering operation, The filtering operation reduces the signal component corresponding to the first sound in the picked-up sound signal, The modulation operation reduces the influence of nonlinear response components in the target response characteristics of the acoustic system on the convergence performance of the filtering operation.

2. The acoustic system according to claim 1, characterized in that The pronunciation component includes: Speakers, and a first peripheral circuit connected to the speaker and the signal processing circuit and comprising at least one first peripheral device; The pickup assembly comprises: Sound sensor, and a second peripheral circuit connected to the sound sensor and the signal processing circuit and comprising at least one second peripheral device; and The target response characteristic represents a response characteristic of at least one target device, wherein the at least one target device includes at least one device among the speaker, the sound sensor, the at least one first peripheral device, and the at least one second peripheral device.

3. The acoustic system according to claim 1, characterized in that The target response characteristic includes at least M nonlinear response components, where M is an integer greater than or equal to 1; and The modulation operation is configured to modulate the to-be-modulated signal by simulating the M nonlinear response components.

4. The acoustic system according to claim 3, characterized in that The target operation further includes a gain amplification operation. When the signal processing circuit performs the target operation: Performing the modulation operation on the driving signal as the signal to be modulated to obtain a modulated signal; Based on the modulated signal, performing the filtering operation on the sound pickup signal to obtain a residual signal; as well as The gain amplification operation is performed on the residual signal to obtain the first target signal.

5. The acoustic system according to claim 4, characterized in that After obtaining the first target signal, the signal processing circuit further: performing the modulation operation on the first target signal to obtain a second target signal; and The parameters of the filtering operation are updated based on the second target signal to make the filtering operation converge.

6. The acoustic system according to claim 3, characterized in that The M nonlinear response components come from N target devices in the acoustic system, where N is an integer greater than or equal to 1; as well as The modulation operation is configured to simulate the M nonlinear response components through a target response model, wherein, The target response model is obtained by measuring the response data of the N target devices and jointly modeling the response data of the N target devices, or The target response model includes N sub-response models corresponding to N target devices, wherein the i-th sub-response model is obtained by measuring the response data of the i-th target device and modeling the response data of the i-th target device, and i is a positive integer less than or equal to N.

7. The acoustic system according to claim 1, characterized in that The target response characteristic includes a linear characteristic, and the linear characteristic corresponds to a linear response interval of N target devices in the acoustic system, where N is an integer greater than or equal to 1; as well as The modulation operation is configured to modulate the signal to be modulated based on the linear characteristic so that the modulated signal corresponds to the linear response interval.

8. The acoustic system according to claim 7, characterized in that The target operation further includes a gain amplification operation. When the signal processing circuit performs the target operation: Based on the driving signal, performing the filtering operation on the sound pickup signal to obtain a residual signal; Performing the gain amplification operation on the residual signal to obtain an amplified signal; and The modulation operation is performed using the amplified signal as the signal to be modulated to obtain the first target signal.

9. The acoustic system according to claim 7, characterized in that The target operation further includes a gain amplification operation. When the signal processing circuit performs the target operation: Based on the driving signal, performing the filtering operation on the sound pickup signal to obtain a residual signal; Performing the modulation operation on the residual signal as the signal to be modulated to obtain a modulated signal; as well as The gain amplification operation is performed on the modulated signal to obtain the first target signal.

10. The acoustic system according to claim 8 or 9, characterized in that: After obtaining the first target signal, the signal processing circuit further: Parameters of the filtering operation are updated based on the first target signal to make the filtering operation converge.

11. The acoustic system according to claim 7, characterized in that The linear feature is obtained by measuring the response data of the N target devices and performing joint modeling on the response data of the N target devices to obtain the linear feature; or The linear characteristic is obtained in the following manner: measuring the response data of the N target devices, modeling the response data of each target device respectively to obtain N sub-signal characteristics corresponding to the N target devices, and determining the linear characteristic based on the N sub-signal characteristics.

12. The acoustic system according to claim 1, characterized in that The filtering operation comprises an adaptive filtering operation; and The modulation operation includes at least one of amplitude modulation, phase modulation, frequency modulation, and filter modulation.

13. A signal processing method, characterized in that: Included, through signal processing circuits in the acoustic system: Obtaining a driving signal, wherein the driving signal is a signal for driving a sound-generating component in the acoustic system to emit a first sound; Obtaining a sound pickup signal, where the sound pickup signal is obtained by a sound pickup component in the acoustic system picking up ambient sound, where the ambient sound includes the first sound and a second sound from a target sound source; as well as A target operation is performed based on the driving signal and the sound pickup signal to generate a first target signal, and the first target signal is sent to the sound generating component as the driving signal, wherein The target operation includes a modulation operation and a filtering operation, The filtering operation reduces the signal component corresponding to the first sound in the picked-up sound signal, The modulation operation reduces the influence of nonlinear response components in the target response characteristics of the acoustic system on the convergence performance of the filtering operation.

14. The method according to claim 13, characterized in that The pronunciation component includes: Speakers, and A first peripheral circuit includes at least one first peripheral device; The pickup assembly comprises: Sound sensor, and A second peripheral circuit includes at least one second peripheral device; and The target response characteristic represents a response characteristic of at least one target device, and the at least one target device includes at least one device among the speaker, the sound sensor, the at least one first peripheral device, and the at least one second peripheral device.

15. The method according to claim 13, characterized in that The target response characteristic includes at least M nonlinear response components, where M is an integer greater than or equal to 1; and The modulation operation is configured to modulate the to-be-modulated signal by simulating the M nonlinear response components.

16. The method according to claim 15, characterized in that The target operation further includes a gain amplification operation, and the target operation is performed based on the drive signal and the sound pickup signal to generate a first target signal, including: Performing the modulation operation on the driving signal as the signal to be modulated to obtain a modulated signal; Based on the modulated signal, performing the filtering operation on the picked-up sound signal to obtain a residual signal; and The gain amplification operation is performed on the residual signal to obtain the first target signal.

17. The method according to claim 16, characterized in that After obtaining the first target signal, the method further includes: performing the modulation operation on the first target signal to obtain a second target signal; and The parameters of the filtering operation are updated based on the second target signal to make the filtering operation converge.

18. The method according to claim 15, characterized in that The M nonlinear response components come from N target devices in the acoustic system, where N is an integer greater than or equal to 1; as well as The modulation operation is configured to simulate the M nonlinear response components through a target response model, wherein, The target response model is obtained by measuring the response data of the N target devices and jointly modeling the response data of the N target devices, or The target response model includes N sub-response models corresponding to N target devices, wherein the i-th sub-response model is obtained by measuring the response data of the i-th target device and modeling the response data of the i-th target device, and i is a positive integer less than or equal to N.

19. The method according to claim 13, characterized in that The target response characteristic includes a linear characteristic, and the linear characteristic corresponds to a linear response interval of N target devices in the acoustic system, where N is an integer greater than or equal to 1; as well as The modulation operation is configured to modulate the signal to be modulated based on the linear characteristic so that the modulated signal corresponds to the linear response interval.

20. The method according to claim 19, characterized in that The target operation further includes a gain amplification operation, and the target operation is performed based on the drive signal and the sound pickup signal to generate a first target signal, including: Based on the driving signal, performing the filtering operation on the sound pickup signal to obtain a residual signal; Performing the gain amplification operation on the residual signal to obtain an amplified signal; and The modulation operation is performed using the amplified signal as the signal to be modulated to obtain the first target signal.

21. The method according to claim 19, characterized in that The target operation further includes a gain amplification operation, and the target operation is performed based on the drive signal and the sound pickup signal to generate a first target signal, including: Based on the driving signal, performing the filtering operation on the sound pickup signal to obtain a residual signal; Performing the modulation operation on the residual signal as the signal to be modulated to obtain a modulated signal; and The gain amplification operation is performed on the modulated signal to obtain the first target signal.

22. The method according to claim 20 or 21, characterized in that After obtaining the first target signal, the method further includes: Parameters of the filtering operation are updated based on the first target signal to make the filtering operation converge.

23. The method according to claim 19, characterized in that The linear feature is obtained by measuring the response data of the N target devices and performing joint modeling on the response data of the N target devices to obtain the linear feature; or The linear characteristic is obtained in the following manner: measuring the response data of the N target devices, modeling the response data of each target device respectively to obtain N sub-signal characteristics corresponding to the N target devices, and determining the linear characteristic based on the N sub-signal characteristics.

24. The method according to claim 13, characterized in that The filtering operation comprises an adaptive filtering operation; and The modulation operation includes at least one of amplitude modulation, phase modulation, frequency modulation, and filter modulation.

Citation Information

Patent Citations

  • Digital hearing aid howling suppression system and suppression method thereof

    CN114584909A

  • Microphone array signal enhancement

    US20030206640A1

  • Clipping detector for echo cancellation

    US20070047731A1

  • Spatial audio array processing system and method

    US20220086592A1