Acoustic system and signal processing method

By using modulation and filtering operations in the acoustic system, the feedback sound and nonlinear response components are reduced, and the howling problem caused by acoustic feedback is solved and the maximum sound gain of the acoustic system is improved.

CN119031298APending Publication Date: 2024-11-26SHENZHEN SHOKZ CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202310603577.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-25
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

There are acoustic feedback problems in the acoustic system, which lead to problems such as howling and limits the maximum sound gain.

Method used

Using an acoustic system including a pronunciation component, a sound pickup component and a signal processing circuit, the feedback sound components in the sound pickup signal are reduced through modulation operations and filtering operations, and the impact of the nonlinear response components on the convergence performance of the filtering operation is reduced through modulation operations.

Benefits of technology

Effectively reduce or eliminate feedback sound, avoid whistling problems, and improve the maximum sound gain of the acoustic system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119031298A_ABST
    Figure CN119031298A_ABST
Patent Text Reader

Abstract

The present specification provides an acoustic system and a signal processing method, a sound production assembly in the acoustic system converts a driving signal into a first sound when working, a pickup assembly picks up an environmental sound and generates a pickup signal when working, the environmental sound comprises the first sound and a second sound from a target sound source, and the second sound comprises a second sound from a target sound source. When the signal processing circuit works, based on the driving signal and the pickup signal, target operation is executed to generate a first target signal, the first target signal is sent to the sounding assembly, and the target operation at least comprises modulation operation and filtering operation; the filtering operation reduces a signal component corresponding to the first sound in the pickup signal, and the modulation operation reduces an influence of a nonlinear response component in a target response characteristic of the acoustic system on convergence performance of the filtering operation. According to the scheme, feedback sound can be reduced or eliminated, the problem that the acoustic system generates howling and the like is avoided, and the maximum sound gain of the acoustic system is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present specification relates to the field of acoustic technology, and in particular to an acoustic system and a signal processing method. Background Art

[0002] Some acoustic systems include both a sound-generating component (such as a speaker, etc.) and a sound-collecting component (such as a sound sensor, etc.). These acoustic systems usually have the problem of acoustic feedback. Among them, acoustic feedback means that the sound-collected signal collected by the sound-collecting component is played through the sound-generating component after a certain processing, and the sound emitted by the sound-generating component is collected again by the sound-collecting component, so that the acoustic system forms a closed loop of "sound-generating component->sound-collecting component->sound-generating component". In the above-mentioned acoustic system, the sound from the sound-generating component picked up by the sound-collecting component can be called feedback sound. The existence of feedback sound causes some problems in the acoustic system. For example, it causes the acoustic system to produce problems such as howling, and may also restrict the maximum sound gain that the acoustic system can achieve. Therefore, it is necessary to provide an acoustic solution that can reduce or eliminate feedback sound. Summary of the invention

[0003] The present specification provides an acoustic system and a signal processing method, which can reduce or eliminate feedback sound, thereby avoiding problems such as howling in the acoustic system, and further improving the maximum sound gain that can be achieved by the acoustic system.

[0004] In a first aspect, the present specification provides an acoustic system, comprising: a sound producing component, a sound pickup component and a signal processing circuit; wherein, when the sound producing component is in operation, it converts a driving signal into a first sound, and when the sound pickup component is in operation, it picks up ambient sound and generates a sound pickup signal, wherein the ambient sound includes the first sound and a second sound from a target sound source, and the signal processing circuit is connected to the sound producing component and the sound pickup component, and when in operation, it performs a target operation based on the driving signal and the sound pickup signal to generate a first target signal, and sends the first target signal as the driving signal to the sound producing component, wherein the target operation includes at least a modulation operation and a filtering operation, wherein the filtering operation reduces the signal component in the sound pickup signal corresponding to the first sound, and the modulation operation reduces the influence of the nonlinear response component in the target response characteristic of the acoustic system on the convergence performance of the filtering operation.

[0005] In some embodiments, the sound-producing component includes a speaker and a first peripheral circuit, the first peripheral circuit is connected to the speaker and the signal processing circuit, and includes at least one first peripheral device; the sound pickup component includes a sound sensor and a second peripheral circuit, the second peripheral circuit is connected to the sound sensor and the signal processing circuit, and includes at least one second peripheral device; and the target response characteristic characterizes the response characteristic of at least one target device, the at least one target device includes at least one device among the speaker, the sound sensor, the at least one first peripheral device, and the at least one second peripheral device.

[0006] In some embodiments, the target response characteristic includes at least M nonlinear response components, where M is an integer greater than or equal to 1; and the modulation operation is configured to modulate the signal to be modulated by simulating the M nonlinear response components.

[0007] In some embodiments, the target operation also includes a gain amplification operation. When the signal processing circuit performs the target operation: the modulation operation is performed on the drive signal as the signal to be modulated to obtain a modulated signal; based on the modulated signal, the filtering operation is performed on the picked-up signal to obtain a residual signal; and the gain amplification operation is performed on the residual signal to obtain the first target signal.

[0008] In some embodiments, after obtaining the first target signal, the signal processing circuit further: performs the modulation operation on the first target signal to obtain a second target signal; and updates the parameters of the filtering operation based on the second target signal to make the filtering operation converge.

[0009] In some embodiments, the M nonlinear response components come from N target devices in the acoustic system, where N is an integer greater than or equal to 1; and the modulation operation is configured to simulate the M nonlinear response components through a target response model, wherein the target response model is obtained by measuring the response data of the N target devices and jointly modeling the response data of the N target devices, or the target response model includes N sub-response models corresponding to the N target devices, wherein the i-th sub-response model is obtained by measuring the response data of the i-th target device and modeling the response data of the i-th target device, and i is a positive integer less than or equal to N.

[0010] In some embodiments, the target response characteristic includes a linear characteristic, which corresponds to a linear response interval of N target devices in the acoustic system, where N is an integer greater than or equal to 1; and the modulation operation is configured to modulate the modulated signal based on the linear characteristic so that the modulated signal corresponds to the linear response interval.

[0011] In some embodiments, the target operation also includes a gain amplification operation. When the signal processing circuit performs the target operation: based on the drive signal, the filtering operation is performed on the pickup signal to obtain a residual signal; the gain amplification operation is performed on the residual signal to obtain an amplified signal; and the modulation operation is performed on the amplified signal as the signal to be modulated to obtain the first target signal.

[0012] In some embodiments, the target operation also includes a gain amplification operation. When the signal processing circuit performs the target operation: based on the drive signal, the filtering operation is performed on the picked-up signal to obtain a residual signal; the modulation operation is performed on the residual signal as the signal to be modulated to obtain a modulated signal; and the gain amplification operation is performed on the modulated signal to obtain the first target signal.

[0013] In some embodiments, after obtaining the first target signal, the signal processing circuit further: updates parameters of the filtering operation based on the first target signal to make the filtering operation converge.

[0014] In some embodiments, the linear feature is obtained by measuring the response data of the N target devices and jointly modeling the response data of the N target devices to obtain the linear feature; or, the linear feature is obtained by measuring the response data of the N target devices, modeling the response data of each target device respectively to obtain N sub-signal features corresponding to the N target devices, and determining the linear feature based on the N sub-signal features.

[0015] In some embodiments, the filtering operation comprises an adaptive filtering operation; and the modulation operation comprises at least one of amplitude modulation, phase modulation, frequency modulation, and filtering modulation.

[0016] In a second aspect, the present specification also provides a signal processing method, comprising: obtaining a driving signal, wherein the driving signal is a signal for driving a sound producing component in the acoustic system to emit a first sound; obtaining a pickup signal, wherein the pickup signal is obtained by the sound producing component in the acoustic system picking up ambient sound, wherein the ambient sound includes the first sound and a second sound from a target sound source; and performing a target operation based on the driving signal and the pickup signal to generate a first target signal, and sending the first target signal as the driving signal to the sound producing component, wherein the target operation includes a modulation operation and a filtering operation, wherein the filtering operation reduces the signal component in the pickup signal corresponding to the first sound, and the modulation operation reduces the influence of the nonlinear response component in the target response characteristics of the acoustic system on the convergence performance of the filtering operation.

[0017] In some embodiments, the sound-producing component includes a speaker and a first peripheral circuit, the first peripheral circuit includes at least one first peripheral device; the sound-picking component includes a sound sensor and a second peripheral circuit, the second peripheral circuit includes at least one second peripheral device; and the target response characteristic characterizes the response characteristic of at least one target device, the at least one target device includes at least one device among the speaker, the sound sensor, the at least one first peripheral device and the at least one second peripheral device.

[0018] In some embodiments, the target response characteristic includes at least M nonlinear response components, where M is an integer greater than or equal to 1; and the modulation operation is configured to modulate the signal to be modulated by simulating the M nonlinear response components.

[0019] In some embodiments, the target operation also includes a gain amplification operation, and the target operation is performed based on the drive signal and the pickup signal to generate a first target signal, including: performing the modulation operation on the drive signal as the signal to be modulated to obtain a modulated signal; based on the modulated signal, performing the filtering operation on the pickup signal to obtain a residual signal; and performing the gain amplification operation on the residual signal to obtain the first target signal.

[0020] In some embodiments, after obtaining the first target signal, the method further includes: performing the modulation operation on the first target signal to obtain a second target signal; and updating parameters of the filtering operation based on the second target signal to make the filtering operation converge.

[0021] In some embodiments, the M nonlinear response components come from N target devices in the acoustic system, where N is an integer greater than or equal to 1; and the modulation operation is configured to simulate the M nonlinear response components through a target response model, wherein the target response model is obtained by measuring the response data of the N target devices and jointly modeling the response data of the N target devices, or the target response model includes N sub-response models corresponding to the N target devices, wherein the i-th sub-response model is obtained by measuring the response data of the i-th target device and modeling the response data of the i-th target device, and i is a positive integer less than or equal to N.

[0022] In some embodiments, the target response characteristic includes a linear characteristic, which corresponds to a linear response interval of N target devices in the acoustic system, where N is an integer greater than or equal to 1; and the modulation operation is configured to modulate the modulated signal based on the linear characteristic so that the modulated signal corresponds to the linear response interval.

[0023] In some embodiments, the target operation also includes a gain amplification operation, and the target operation is performed based on the drive signal and the pickup signal to generate a first target signal, including: based on the drive signal, performing the filtering operation on the pickup signal to obtain a residual signal; performing the gain amplification operation on the residual signal to obtain an amplified signal; and performing the modulation operation on the amplified signal as the signal to be modulated to obtain the first target signal.

[0024] In some embodiments, the target operation also includes a gain amplification operation, and the target operation is performed based on the drive signal and the pickup signal to generate a first target signal, including: based on the drive signal, performing the filtering operation on the pickup signal to obtain a residual signal; performing the modulation operation on the residual signal as the signal to be modulated to obtain a modulated signal; and performing the gain amplification operation on the modulated signal to obtain the first target signal.

[0025] In some embodiments, after obtaining the first target signal, the method further includes: updating parameters of the filtering operation based on the first target signal so that the filtering operation tends to converge.

[0026] In some embodiments, the linear feature is obtained by measuring the response data of the N target devices and jointly modeling the response data of the N target devices to obtain the linear feature; or, the linear feature is obtained by measuring the response data of the N target devices, modeling the response data of each target device respectively to obtain N sub-signal features corresponding to the N target devices, and determining the linear feature based on the N sub-signal features.

[0027] In some embodiments, the filtering operation comprises an adaptive filtering operation; and the modulation operation comprises at least one of amplitude modulation, phase modulation, frequency modulation, and filtering modulation.

[0028] It can be seen from the above technical solutions that the acoustic system and signal processing method provided in this specification, the sound generating component in the acoustic system converts the driving signal into the first sound when working, the sound pickup component picks up the ambient sound and generates the sound pickup signal when working, the ambient sound includes the first sound and the second sound from the target sound source, the signal processing circuit is connected to the sound generating component and the sound pickup component, and when working, the target operation is performed based on the driving signal and the sound pickup signal to generate the first target signal, and the first target signal is sent to the sound generating component as the driving signal, wherein the target operation at least includes a modulation operation and a filtering operation. Since the filtering operation reduces the signal component corresponding to the first sound in the sound pickup signal, the solution provided in this specification can reduce or eliminate the feedback sound, thereby avoiding the problem of howling caused by the feedback sound, and helps to improve the maximum sound gain that the acoustic system can achieve. Further, since the modulation operation reduces the influence of the nonlinear response component in the target response characteristic of the acoustic system on the convergence performance of the filtering operation, the solution provided in this specification can also improve the convergence performance of the filtering operation, thereby further improving the cancellation effect of the feedback sound.

[0029] Other functions of the acoustic system and signal processing method provided in this specification will be partially listed in the following description. The creative aspects of the acoustic system and signal processing method provided in this specification can be fully explained by practicing or using the methods, devices and combinations described in the following detailed examples. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the technical solutions in the embodiments of this specification, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0031] Figure 1 A schematic diagram showing an application scenario provided according to an embodiment of this specification;

[0032] Figure 2 A schematic diagram of a design of an acoustic system provided according to an embodiment of this specification is shown;

[0033] Figure 3 Another schematic diagram of the design of an acoustic system provided according to an embodiment of this specification is shown;

[0034] Figure 4 Another schematic diagram of a design of an acoustic system provided according to an embodiment of this specification is shown;

[0035] Figure 5 Another schematic diagram of a design of an acoustic system provided according to an embodiment of this specification is shown;

[0036] Figure 6 Another schematic diagram of a design of an acoustic system provided according to an embodiment of this specification is shown;

[0037] Figure 7 The test results of the acoustic system provided in the embodiment of this specification in terms of filtering performance are shown;

[0038] Figure 8 A schematic diagram of a hardware structure of an acoustic system provided according to an embodiment of this specification is shown; and

[0039] Fig. 9 A flow chart of a signal processing method provided according to an embodiment of this specification is shown. DETAILED DESCRIPTION

[0040] The following description provides specific application scenarios and requirements of this specification, with the purpose of enabling those skilled in the art to make and use the contents of this specification. Various local modifications to the disclosed embodiments will be apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of this specification. Therefore, this specification is not limited to the embodiments shown, but to the widest scope consistent with the claims.

[0041] The terms used herein are only used for the purpose of describing specific example embodiments and are not restrictive. For example, unless the context clearly indicates otherwise, as used herein, the singular forms "a", "an" and "the" may also include plural forms. When used in this specification, the terms "include", "comprise" and / or "contain" mean that the associated integers, steps, operations, elements and / or components exist, but do not exclude the existence of one or more other features, integers, steps, operations, elements, components and / or groups or that other features, integers, steps, operations, elements, components and / or groups may be added in the system / method.

[0042] In view of the following description, these and other features of the present specification, as well as the operation and function of the related elements of the structure, and the economy of the combination and manufacture of the parts can be significantly improved. Reference is made to the accompanying drawings, all of which form a part of this specification. However, it should be clearly understood that the drawings are for illustration and description purposes only and are not intended to limit the scope of this specification. It should also be understood that the drawings are not drawn to scale.

[0043] The flowcharts used in this specification illustrate the operations implemented by the system according to some embodiments in this specification. It should be clearly understood that the operations of the flowcharts may not be implemented in sequence. On the contrary, the operations may be implemented in reverse order or simultaneously. In addition, one or more other operations may be added to the flowchart. One or more operations may be removed from the flowchart.

[0044] Before describing the specific embodiments of this specification, the application scenarios of this specification are first introduced as follows. The solution provided in this specification can be applied to scenarios where feedback sound needs to be reduced or eliminated. Figure 1 Give an example.

[0045] Figure 1 FIG. 1 is a schematic diagram showing an application scenario provided according to an embodiment of this specification. Figure 1As shown, application scenario 001 can be a sound amplification scenario, a hearing aid scenario, an auxiliary listening scenario, etc. In this scenario, the sound pickup component 120 collects environmental sounds when working. In this specification, environmental sounds refer to sounds in the environment, that is, environmental sounds can include sounds emitted by all sound sources in the environment. During the sound pickup process of the sound pickup component 120, if the sound generating component 110 and the target sound source 160 are both emitting sounds, the environmental sounds collected by the sound pickup component 120 include both sounds from the target sound source 160 and sounds from the sound generating component 110. Furthermore, the sound pickup signal collected by the sound pickup component 120 is sent to the sound generating component 110 after gain amplification (G), thereby driving the sound generating component 110 to emit sounds. In this way, a closed loop of "sound generating component->sound pickup component->sound generating component" is formed in the acoustic system. In this case, a howling phenomenon will occur when a sound signal of a certain frequency undergoes self-excited oscillation. Such howling will make the user feel uncomfortable, and when the howling is severe, it may also cause damage to the components in the acoustic system. In addition, the existence of the howling also brings limitations to the gain amplification factor of the acoustic system, thereby restricting the maximum sound gain that can be achieved by the acoustic system.

[0046] It should be noted that the above Figure 1 The application scenarios shown are only some of the multiple application scenarios to which the embodiments of this specification are applicable. The acoustic system provided by the embodiments of this specification can also be applied to other similar scenarios, which are not listed one by one in this specification. Those skilled in the art should understand that the solutions provided by the embodiments of this specification applied to other usage scenarios are also within the protection scope of the embodiments of this specification.

[0047] In summary, the presence of feedback sound will cause a series of problems in the acoustic system, including but not limited to: generating howling, restricting the maximum acoustic gain that the acoustic system can achieve, etc.

[0048] In some embodiments, the acoustic system can use acoustic feedback cancellation (AFC) technology to reduce or eliminate feedback sound. Figure 2 The principle of AFC technology is introduced.

[0049] Figure 2 1 shows a schematic diagram of a design of an acoustic system provided according to an embodiment of the present specification. The acoustic system 10 may be a hearing aid system, an auxiliary hearing system, or a sound amplification system. Figure 2 As shown, the acoustic system 10 may include a sound producing component 110 , a sound pickup component 120 , and a signal processing circuit 150 .

[0050] The sound generating component 110 is a component with a sound generating function. The sound generating component 110 can be connected to the output port of the signal processing circuit 150, and when working, receives a driving signal from the signal processing circuit 150 and converts it into sound to play. Figure 2 , the pronunciation component 110 may include a speaker 111 and a first peripheral circuit 112 (the first peripheral circuit is represented by C1 in the accompanying drawings). Among them, the speaker 111 is a device for converting an electrical signal into sound, and may also be called an electroacoustic converter. For example, the speaker 111 may be a speaker. The first peripheral circuit 112 is connected between the output port of the signal processing circuit 150 and the speaker 110. The first peripheral circuit 112 may refer to all circuits or part of the circuits between the output port of the signal processing circuit 150 and the speaker 110. The first peripheral circuit 112 may perform some processing on the electrical signal output by the signal processing circuit 150 so that the processed electrical signal is suitable for playback by the speaker 110. The first peripheral circuit 112 may include at least one first peripheral device, and the first peripheral device includes but is not limited to operational amplifier devices, power amplifier devices, digital-to-analog converter devices, filter devices, tuning devices, capacitors, resistors, inductors, chips and other devices.

[0051] It should be noted that the speaker 111 can be a device that produces sound based on at least one conduction method among gas, liquid, and solid, and this specification does not limit this. The speaker 111 can be a speaker itself, or it can include a speaker and simple circuit elements attached thereto. The number of speakers 111 can be one or more. When the number of speakers 111 is multiple, the multiple speakers 111 can be arranged in an array. In addition, when the number of speakers 111 is multiple, the multiple speakers 111 can be connected to the signal processing circuit 150 through the same first peripheral circuit 112, or the multiple speakers 111 can also be connected to the signal processing circuit 150 through different first peripheral circuits 112.

[0052] The sound pickup component 120 is a component with a sound pickup function. The sound pickup component 120 can be connected to the input port of the signal processing circuit 150, pick up ambient sound to generate a sound pickup signal when working, and send the sound pickup signal to the signal processing circuit 150. Figure 2, the sound pickup component 120 may include at least one sound sensor 121 and a second peripheral circuit 122 (C2 is used in the accompanying drawings to represent the second peripheral circuit). Among them, the sound sensor 121 is a device for picking up sound and converting the sound into an electrical signal, and may also be called an acoustic-electric converter. For example, the sound sensor 121 may be a microphone (MIC). The second peripheral circuit 122 is connected between the sound sensor 121 and the input port of the signal processing circuit 150. The second peripheral circuit 122 may refer to all circuits or part of the circuits between the sound sensor 121 and the input port of the signal processing circuit 150. The second peripheral circuit 122 may perform some processing on the electrical signal (i.e., the sound pickup signal) picked up by the sound sensor 121 so as to convert it into a signal suitable for processing by the signal processing circuit 150. The second peripheral circuit 122 may include at least one second peripheral device, and the second peripheral device may include but is not limited to power amplifier devices, operational amplifier devices, analog-to-digital converter devices, filter devices, tuning devices, capacitors, resistors, inductors, chips and other devices.

[0053] It should be noted that the sound sensor 121 can be a device that picks up sound based on at least one conductive method among gas, liquid, and solid, and this specification does not limit this. The sound sensor 121 can be the MIC itself, or it can include the MIC and its accompanying simple circuit elements. The number of sound sensors 121 can be one or more. When the number of sound sensors 121 is multiple, the multiple sound sensors 121 can be arranged in an array. In addition, when the number of sound sensors 121 is multiple, the multiple sound sensors 121 can be connected to the signal processing circuit 150 through the same second peripheral circuit 122, or the multiple sound sensors 121 can also be connected to the signal processing circuit 150 through different second peripheral circuits 122.

[0054] Continue to see Figure 2, the working process of the acoustic system 10 is as follows: the sound pickup component 120 collects environmental sound to generate a sound pickup signal y, and inputs the sound pickup signal y to the signal processing circuit 150. The environmental sound at least includes a second sound emitted by the target sound source 160. The target sound source 160 refers to other sound sources other than the sound generating component 110. For example, the target sound source 160 may include an electronic device with a sound playing function (such as a television, a speaker, a mobile phone, etc.); for another example, the target sound source 160 may also include a human throat. The above-mentioned sound pickup signal y can be called the input signal of the signal processing circuit 150. The signal processing circuit 150 performs a series of processing on the sound pickup signal y to obtain a drive signal u, and sends the drive signal u to the sound generating component 110. The above-mentioned drive signal u can be used as the output signal of the signal processing circuit 150. The sound generating component 110 receives the drive signal u and converts it into a first sound. The first sound is re-collected by the sound sensor 120 after being transmitted through the feedback path, so the first sound can also be called a feedback sound. It can be seen that the ambient sound collected by the sound pickup component 120 includes not only the second sound from the target sound source 160, but also the first sound from the sound generating component 110. In other words, the sound pickup signal y includes both the signal component x corresponding to the first sound (i.e., the feedback sound) and the signal component v corresponding to the second sound.

[0055] The signal processing circuit 150 may be a circuit with certain signal processing capabilities. The input port of the signal processing circuit 150 is connected to the sound pickup component 120, and the output port is connected to the sound generating component 110. The signal processing circuit 150 may obtain the driving signal u inside it, and obtain the sound pickup signal y from the sound pickup component 120, and then, perform a target operation based on the driving signal u and the sound pickup signal y to generate a first target signal, and send the first target signal as a new driving signal (i.e., the driving signal u at the next moment) to the sound generating component 110.

[0056] The target operation at least includes a filtering operation. The filtering operation is configured to reduce the signal component corresponding to the first sound in the sound pickup signal y, that is, the filtering operation can reduce the feedback component in the sound pickup signal y. The filtering operation may include an adaptive filtering operation. For example, the adaptive filtering operation may be a filtering operation based on the AFC technology. Figure 2 The operation principle of the AFC-based filtering is described in detail.

[0057] Continue to see Figure 2, the signal processing circuit 150 may include a filtering unit 170. The input of the filtering unit 170 includes: a driving signal u and a sound pickup signal y. The filtering unit 170 may reduce the signal component corresponding to the first sound in the sound pickup signal y based on the driving signal u, thereby obtaining a signal e. Specifically, it is assumed that the acoustic transfer function from the speaker 111 to the sound sensor 121 is F. The filtering unit 170 may solve and adaptively update a time-varying transfer function F' to fit F. To distinguish, the transfer function F' is hereinafter referred to as the predicted transfer function F', and F is referred to as the real transfer function F. The filtering unit 170 uses the predicted transfer function F' to perform an adaptive filtering operation on the driving signal u to obtain a signal x', that is, x'=u*F'. The signal x' can be regarded as a predicted value of the feedback component in the sound pickup signal y (that is, the signal component corresponding to the first sound in the sound pickup signal y). Furthermore, the filtering unit 170 may subtract the signal x' from the sound pickup signal y to obtain a signal e, that is, e=y-x'. The signal e obtained in this way contains no or less feedback sound components.

[0058] It should be noted that the above-mentioned filtering unit 170 can adopt a variety of adaptive filtering algorithms when solving the prediction transfer function F', for example, one or more of the least mean square (Least Mean Square, LMS), normalized least mean square (Normalized Least Mean Square, NLMS), recursive least squares (Recursive least squares, RLS), etc. can be adopted, and the embodiments of this specification do not limit this. In addition, the adaptive filtering algorithm can be adaptive filtering in the time domain, frequency domain or other transform domains.

[0059] The target operation may also include a gain amplification operation. Figure 2 The signal processing circuit 150 may further include a gain amplifier unit 130. The gain amplifier unit 130 may perform a gain amplification operation on the signal e to obtain a first target signal. The signal processing circuit 150 sends the first target signal as a driving signal u at the next moment to the sounding component 110 to drive the sounding component 110 to make a sound.

[0060] According to the theory of adaptive filtering algorithm, the update method of the predicted transfer function F' can be achieved by minimizing the expectation of the mean square function of the signal e, that is:

[0061] min F′ E[e 2 ]=min F′ E[(yu*F′) 2 ] Formula (1-1)

[0062] For example, taking the filtering unit 170 using the LMS algorithm as an example, the above formula (1-1) is derived based on the optimization method of gradient descent, and the update formula of the predicted transfer function F' can be obtained as follows:

[0063] F′←F′+μ*e*u formula (2-1)

[0064] Among them, μ is the iteration step size.

[0065] It should be understood that when the filtering unit 170 adopts algorithms such as NLMS, RLS, etc., a similar method can be used to derive an update formula for the prediction transfer function F', which will not be described one by one in this specification.

[0066] In summary, Figure 2 The acoustic system shown can reduce or eliminate feedback sound by performing an AFC-based filtering operation, thereby avoiding problems such as howling caused by the feedback sound and helping to improve the maximum sound gain that can be achieved by the acoustic system.

[0067] According to signal processing theory, Figure 2 The closed-loop gain A of the acoustic system shown can be expressed as follows:

[0068]

[0069] According to the Nyquist stability criterion, the requirement for an acoustic system to offset feedback sound is that the predicted transfer function F′ is completely equal to the true transfer function F, that is, F′ = F. When the above requirements are met, the acoustic system will always be stable and will not produce howling. In addition, the acoustic system can achieve infinite gain, that is, when G→∞, A=G→∞.

[0070] However, in an actual acoustic system, since the real transfer function F may be time-varying and the convergence process of the iterative solution may oscillate, it is difficult for the iterative process of F' to reach the ideal condition F'=F. In other words, there is a certain deviation between the predicted transfer function F' obtained by the actual iteration and the real transfer function F. At this time, in order to keep the acoustic system stable, the gain G provided by the gain amplifier unit 130 naturally cannot be infinite. The maximum gain that the acoustic system can achieve is:

[0071]

[0072] As can be seen from formula (4), the deviation between the predicted transfer function F′ and the true transfer function F can be used to measure the convergence performance of the adaptive filtering algorithm, and further measure the acoustic system's effect of canceling feedback sound. Specifically, if the deviation between the predicted transfer function F′ and the true transfer function F is smaller, it means that the convergence performance of the adaptive filtering algorithm is better, and thus the acoustic system's effect of canceling feedback sound is better. If the deviation between the predicted transfer function F′ and the true transfer function F is larger, it means that the convergence performance of the adaptive filtering algorithm is worse, and thus the acoustic system's effect of canceling feedback sound is worse.

[0073] In some embodiments, we can also use misalignment (MIS) to measure the convergence performance of the adaptive filtering algorithm. The misalignment MIS can be expressed by the following formula:

[0074]

[0075] The unit of the offset MIS is decibel (dB). When the predicted transfer function F′ is the initial value zero, the offset MIS is 0dB. When the offset MIS is smaller and approaches negative infinity, the deviation between the predicted transfer function F′ and the true transfer function F is smaller, indicating that the convergence performance of the adaptive filtering algorithm is better, and thus the acoustic system has a better effect of canceling feedback sound. When the offset MIS is larger and approaches positive infinity, the deviation between the predicted transfer function F′ and the true transfer function F is larger, indicating that the convergence performance of the adaptive filtering algorithm is worse, and thus the acoustic system has a worse effect of canceling feedback sound.

[0076] It should be noted that the convergence performance of the adaptive filtering algorithm in the embodiments of this specification includes but is not limited to: convergence speed, convergence error, etc. The convergence speed may refer to the fitting speed of the predicted transfer function F′ to the true transfer function F, and the convergence error may refer to the deviation between the predicted transfer function F′ and the true transfer function F when the convergence condition is met.

[0077] exist Figure 2 In the acoustic system shown, the reason why a time-varying predicted transfer function F′ can be solved by an adaptive filtering algorithm to fit the real transfer function F is that the transfer effect of the sound-generating component 110 and the sound-collecting component 120 is ignored, or in other words, it is assumed that the sound-generating component 110 and the sound-collecting component 120 are ideal linear transducers. That is, it is assumed that the transfer function of the sound-generating component 110 is 1 (or a constant k1), and the transfer function of the sound-collecting component 120 is 1 (or a constant k2). In the following, for simplified description, the transfer functions of the ideal linear transducers are all described as 1 without loss of generality.

[0078] However, the above assumption is usually not true in the actual acoustic system. The actual acoustic system is analyzed below. The transfer function of the sounding component 110 is denoted as F SPK , the transfer function of the pickup assembly 120 is recorded as F MIC .at this time, Figure 2 The closed-loop gain A of the acoustic system shown can be expressed as follows:

[0079]

[0080] According to the Nyquist stability criterion, the requirement for the acoustic system to cancel the feedback sound is that the predicted transfer function F′ to be solved needs to fit F SPK , F and F MIC The common transmission effect of these three, that is, F′=F SPK *F*F MIC .

[0081] In an actual acoustic system, the sound pickup assembly 120 generally includes a sound sensor 121 and a second peripheral circuit 122. The components in the sound sensor 121 and the second peripheral circuit 122 have a good linear response within the dynamic range of a common audio signal. Therefore, according to signal processing theory, under the assumption of short-term stability, the transfer effect of the sound pickup assembly 120 can be approximately ignored. In other words, the transfer function F of the sound pickup assembly 120 is MIC It can be recorded as 1.

[0082] The sound generating component 110 generally includes a loudspeaker 111 and a first peripheral circuit 112. The interaction between the diaphragm and magnet of the loudspeaker 111 leads to hysteresis effect and saturation distortion, etc., so the response of the loudspeaker 111 includes nonlinear response components. The first peripheral circuit 112 generally includes devices such as power amplifiers and operational amplifiers. The power amplifiers and operational amplifiers generally have limiting effects, so the responses of the two also include nonlinear response components. Similarly, other devices in the first peripheral circuit 112 may also have nonlinear response components. It can be seen that the transfer function F of the sound generating component 110 is SPK There are nonlinear response components.

[0083] exist Figure 2 In the scheme shown, since the filter unit 170 obtains the driving signal u at a position before the output port of the signal processing circuit 150 and adaptively filters the driving signal u using the predicted transfer function F′, the transfer function F of the sounding component 110 is SPKThe nonlinear response components in are inevitably introduced into the iterative solution of the predicted transfer function F′. The adaptive filtering algorithm is usually suitable for tracking time-varying linear systems. The introduction of the above nonlinear response components will lead to low convergence performance of the adaptive filtering algorithm, for example, the predicted transfer function F′ cannot converge, converges slowly, or has a large convergence error. This makes the acoustic system's misalignment index MIS worse, which in turn affects the acoustic system's effect of counteracting feedback sound.

[0084] To this end, the solution provided in the embodiment of this specification adds a modulation operation inside the signal processing circuit 150 to reduce the influence of the nonlinear response component on the convergence performance of the filtering operation. Figures 3 to 6 Describe in detail.

[0085] Figure 3 Another design schematic diagram of an acoustic system provided according to an embodiment of this specification is shown. Figure 3 The signal processing circuit 150 may further include a modulation unit 180. The modulation unit 180 is configured to perform a modulation operation. That is, the target operation performed by the signal processing circuit 150 includes a filtering operation, a modulation operation, and a gain amplification operation. It should be noted that the specific implementation of the filtering unit 170 and the gain amplification unit 130 can be found in Figure 2 The relevant description is not repeated here.

[0086] The modulation unit 180 may modulate the signal to reduce the influence of the nonlinear response component in the target response characteristic of the acoustic system on the convergence performance of the filtering operation.

[0087] Specifically, the target response characteristic can characterize the response characteristics of N target devices in the acoustic system, where N is an integer greater than or equal to 1. According to the foregoing description, the first peripheral circuit 112 may include at least one first peripheral device, and the second peripheral circuit 122 may include at least one second peripheral device. The N target devices may include a speaker 111, a sound sensor 121, at least one of the at least one first peripheral device, and at least one of the at least one second peripheral device. In other words, the target response characteristic can characterize the response characteristics of at least one of the speaker 111, the sound sensor 121, the at least one first peripheral device, and the at least one second peripheral device. It can be understood that when the value of N is greater than 1, the target response characteristic actually characterizes: the response of the system when the N target devices are regarded as a system.

[0088] In the embodiments of this specification, the response characteristic of device A may refer to a characteristic that characterizes the relationship between the output signal and the input signal of device A. For example, assuming that the input signal of device A is denoted as S in, the output signal is recorded as S out , then it represents S out With S in The mathematical expression / model of the relationship between can be used as the response characteristic of device A. If the output signal s of device A out With the input signal S in If the output signal S of device A is linear, it means that device A exhibits a linear response. out With the input signal S in When there is a nonlinear relationship between , it means that device A exhibits a nonlinear response. In some cases, the response characteristics of device A may include both linear response components and nonlinear response components. It should be noted that when the response characteristics of device A include nonlinear response components, the number of the nonlinear response components may be one or more. For example, assuming that the response characteristics of device A can be recorded as: S out =f1(S in )+f2(S in )+f3(S in ), where f1 is the linear response component, and f2 and f3 are the nonlinear response components, it means that the response characteristics of device A include both the linear response component and two nonlinear response components.

[0089] Since the target response characteristic characterizes the response characteristics of N target devices, when the response characteristics of at least one target device among the N target devices include a nonlinear response component, the target response characteristic also includes a nonlinear response component. It should be noted that the number of items of the nonlinear response components included in the target response characteristic may be one or more items. For ease of expression, in the following expression, it is assumed that the target response characteristic includes M nonlinear response components, and M may be an integer greater than or equal to 1. It can be understood that in addition to the M nonlinear response components, the target response characteristic may also include a linear response component.

[0090] As mentioned above, when the response characteristics of at least one of the speaker 111, the sound sensor 121, the first peripheral circuit 112 (i.e., the at least one first peripheral device), and the second peripheral circuit 122 (i.e., the at least one second peripheral device) have nonlinear response components, the nonlinear response components will affect the convergence performance of the filtering operation (e.g., the adaptive filtering operation based on AFC). Figure 3In the acoustic system shown, the modulation operation performed by the modulation unit 180 may be an operation of performing modulation based on the nonlinear response component in the target response feature. In this way, the modulation unit 180 can reduce the influence of the nonlinear response component on the convergence performance of the filtering operation by performing the modulation operation, thereby improving the convergence performance of the filtering operation, and further improving the effect of canceling the feedback sound in the acoustic system.

[0091] In some embodiments, considering that the response characteristics of the sound sensor 121 and the second peripheral circuit 122 generally do not contain or contain less nonlinear response components, while the response characteristics of the speaker 111 and the first peripheral circuit 112 generally contain or contain more nonlinear response components. Therefore, in order to simplify the implementation of the modulation unit 180, the target response characteristic can characterize the response characteristic of the speaker 111, or the target response characteristic can characterize the response characteristic of the at least one first peripheral device (such as a power amplifier, an operational amplifier, etc. in the first peripheral circuit 112), or the target response characteristic can characterize the response characteristics of the speaker 111 and the at least one first peripheral device.

[0092] The modulation operation performed by the modulation unit 180 may include at least one of amplitude modulation, phase modulation, frequency modulation, and filter modulation.

[0093] The amplitude modulation refers to a method of modulating the amplitude of a signal. It should be noted that there are many ways to modulate the amplitude of a signal, and this specification does not limit this. For example, the amplitude of the modulated signal can be clipped to achieve modulation.

[0094] The phase modulation refers to a method of modulating the phase of a signal. It should be noted that there are many ways to modulate the phase of a signal, and this specification does not limit this. For example, the phase of the modulated signal can be changed to achieve modulation.

[0095] The frequency modulation refers to a method of modulating the frequency of a signal. It should be noted that there are many ways to modulate the frequency of a signal, and this specification does not limit this. For example, the frequency of the modulated signal can be changed to achieve modulation.

[0096] The filtering modulation refers to a method of implementing modulation by filtering a signal. It should be noted that there may be many methods of filtering a signal, and this specification does not limit this. For example, the signal to be modulated may be input into a preset filter to implement modulation.

[0097] When performing the modulation operation, the modulation unit 180 may adopt one or more of amplitude modulation, phase modulation, frequency modulation, and filter modulation. When the modulation unit 180 adopts multiple modulation methods, the modulation method of the signal is more flexible and can meet the modulation requirements of different scenarios.

[0098] based on Figure 3 In the scheme shown, when designing the modulation operation performed by the modulation unit 180, the design may be performed from different modulation principle dimensions. Two possible modulation principles are used as examples for illustration.

[0099] Modulation Principle 1: The modulation operation is configured to simulate the nonlinear response component in the target response characteristic.

[0100] Specifically, it is assumed that the target response characteristic includes at least M nonlinear response components, where M is an integer greater than or equal to 1. When performing the modulation operation, the modulation unit 180 can modulate the signal to be modulated by simulating the M nonlinear response components.

[0101] The M nonlinear response components may come from N target devices in the acoustic system, that is, the M nonlinear response components are introduced by the N target devices, and N is an integer greater than or equal to 1. As mentioned above, the N target devices may include at least one of the speaker 111, the sound sensor 121, the first peripheral circuit 112, and the second peripheral circuit 122. In this case, the nonlinear response conditions of the N target devices may be modeled in advance to obtain a target response model. The target response model may be a mathematical expression for characterizing the nonlinear response conditions of the N target devices. The mathematical expression may be in the form of a neural network, a function, or other possible forms. The target response model is used to reproduce the nonlinear response conditions of the N target devices. For example, assuming that the signal S1 is input into the target response model to obtain the signal S2, the signal S2 may be regarded as "the result signal containing the M nonlinear response components obtained after the N target devices process the signal S1".

[0102] When modeling the nonlinear response of the N target devices, a joint modeling method or a separate modeling method may be used. The two modeling methods are introduced below.

[0103] (1) Joint modeling approach.

[0104] During the operation of the acoustic system, the response data of the N target devices can be measured. The response data of each target device may include output data corresponding to different values ​​of input variables, wherein the input variables include but are not limited to: continuous working time, operating frequency, input signal amplitude, power supply voltage, temperature, humidity and other data. Further, the response data of the N target devices are jointly modeled to obtain the target response model. Specifically, based on the response data of the N target devices, the deviation statistics of the response conditions of the N target devices relative to the ideal linear component are analyzed. Among them, the deviation statistics may include but are not limited to statistics of at least one dimension of clipping distortion, harmonic distortion, difference frequency distortion, intermodulation distortion, repeatability, hysteresis, and resolution. Then, the response data whose deviation statistics exceed the preset threshold are modeled to obtain the target response model.

[0105] It should be understood that the target response model obtained by the joint modeling method simulates the nonlinear response of the N target devices under the joint action.

[0106] (2) Separate modeling method

[0107] During the operation of the acoustic system, the response data of the N target devices can be measured. Then, the response data of each target device is modeled separately to obtain a sub-response model corresponding to the target device. It should be understood that when each target device is modeled separately, the specific modeling method is similar to the joint modeling method, which will not be described here. The difference between the separate modeling method and the joint modeling method is that the separate modeling method is to model each target device separately, while the joint modeling method is to model the N target devices as a whole.

[0108] When a separate modeling method is adopted, a sub-response model can be separately modeled for each target device. Therefore, in this case, the target response model actually includes N sub-response models corresponding to the N target devices. Each sub-response model simulates the nonlinear response of a single target device. Therefore, when using the target response model, the N sub-response models can be used in series in sequence to simulate the nonlinear response of the N target devices.

[0109] After the target response model is obtained by modeling, the modulation unit 180 can simulate the M nonlinear response components through the target response model when performing the modulation operation, thereby modulating the signal to be modulated. Specifically, the modulation unit 180 can input the signal to be modulated into the target response model, and the target response model modulates the signal to be modulated and outputs a modulated signal.

[0110] Based on the modulation principle of the above modulation operation, the following Figure 4 The process of the signal processing circuit 150 performing the target operation is exemplified.

[0111] Figure 4 FIG. 2 shows another design schematic diagram of an acoustic system provided according to an embodiment of the present specification. Figure 4 As shown, the modulation unit 180 may be located on the branch where the filtering unit 170 is located. In this case, the process of the signal processing circuit 150 performing the target operation is as follows:

[0112] (1) The signal processing circuit 150 outputs the driving signal u and obtains the sound pickup signal y from the sound pickup assembly 120 .

[0113] (2) The drive signal u is used as the signal to be modulated and the modulation operation is performed to obtain the modulated signal u′. For example, the drive signal u is input into the target response model to obtain the modulated signal u′. That is, u′=u*M.

[0114] Wherein, M represents the transfer function corresponding to the modulation operation, or in other words, M represents the target response model.

[0115] (3) Based on the modulated signal u′, the filtering operation is performed on the picked-up signal y to obtain a residual signal e.

[0116] Specifically, see Figure 4 , adaptively filter the modulated signal u' using the prediction transfer function F' to obtain the signal x', that is, x'=u'*F'. The signal x' can be regarded as the predicted value of the feedback component in the sound pickup signal y (that is, the signal component corresponding to the first sound in the sound pickup signal y). Then, the signal x' is subtracted from the sound pickup signal y to obtain the residual signal e. That is, e=yx'=yu'*F'=y-(u*M)*F'. The residual signal e obtained in this way does not contain or contains less feedback sound components.

[0117] (4) Performing the gain amplification operation on the residual signal e to obtain the first target signal (ie, the driving signal u at the next moment), ie, u=e*G.

[0118] Below Figure 4 The updating method of the prediction transfer function F′ in the scheme shown is explained. According to the theory of the adaptive filtering algorithm, the updating method of the prediction transfer function F′ can be achieved by minimizing the expectation of the mean square function of the residual signal e, that is:

[0119] min F′ E[e 2 ]=min F′ E[(y-(u*M)*F′) 2 ] Formula (1-2)

[0120] Still taking the filtering unit 170 using the LMS algorithm as an example, the above formula (1-2) is derived based on the optimization method of gradient descent, and the update formula of the prediction transfer function F′ can be obtained as follows:

[0121] F′←F′+μ*e*(u*M) formula (2-2)

[0122] It can be seen that after obtaining the first target signal u, the signal processing circuit 150 can also perform the modulation operation on the first target signal u to obtain the second target signal (i.e., u*M). Then, according to the above formula (2-2), the prediction transfer function F′ is updated based on the second target signal (i.e., the parameters of the filtering operation are updated) to make the filtering operation converge.

[0123] exist Figure 4 In the scheme shown, the process of the modulation unit 180 performing the modulation operation is equivalent to simulating the "nonlinear response process of N target devices to the driving signal u". It can be understood that when the N target devices include all the devices in the sound-generating component 110 and the sound-pickup component 120, it is equivalent to the modulation operation simulating all the nonlinear response components in the feedback path, and the predicted transfer function F' is only responsible for tracking the linear response components in the feedback path; when the N target devices include some of the devices in the sound-generating component 110 and the sound-pickup component 120, it is equivalent to the modulation operation simulating at least part of the nonlinear response components in the feedback path, and the predicted transfer function F' needs to be responsible for tracking the linear response components in the feedback path and the remaining nonlinear response components. It can be seen that the solution of the predicted transfer function F' will not introduce or introduce fewer nonlinear response components, thereby improving the convergence performance of the filtering operation, and further improving the cancellation effect of the feedback sound.

[0124] It should be noted that in the above Figure 4 In the scheme shown, when the modulation unit 180 performs the modulation operation, the target response model simulates the nonlinear response component in the target response characteristic. In some cases, the target response characteristic may also contain a linear response component in addition to the nonlinear response component. For the linear response component, the target response model may simulate or not simulate.

[0125] When the target response model does not simulate the linear response component, the linear response component will be fitted into the predicted transfer function F′ together with the acoustic transfer function F. That is to say, the predicted transfer function F′ ultimately fits the combined effect of the transfer function F and the linear response component.

[0126] In the case where the target response model simulates the linear response component, it is assumed that the modulation operation fully simulates the transfer function F of the sound generation component 110 SPK and the transfer function F of the pickup assembly 120 MIC , that is, M=F SPK *F MIC In this case, the closed-loop gain A of the acoustic system can be expressed as follows:

[0127]

[0128] It can be seen from formula (3-4) that the predicted transfer function F′ ultimately fits the acoustic transfer function F between the speaker 111 and the sound sensor 121. In this way, the predicted transfer function F′ is reduced to F SPK and F MIC of tracking pressure.

[0129] Modulation Principle 2: The modulation operation is configured to modulate the signal to be modulated so that the modulated signal operates in the linear response range of the target device.

[0130] The following takes device A as an example to illustrate the meaning of the linear response interval. Assuming that device A is an ideal linear device, device A exhibits a linear response to any input variable (such as time, frequency, amplitude, phase, temperature, humidity, etc.). However, in actual acoustic scenarios, the above ideal assumptions are usually not met, and device A usually exhibits a linear response only under certain conditions. For example, when the input variable X1 is in the first interval, device A exhibits a linear response, and when the input variable X1 is in other intervals, device A exhibits a nonlinear response. In this case, the first interval of the input variable X1 can be used as the linear response interval of device A. For another example, when the input variable X2 is in the second interval, device A exhibits a linear response, and when the input variable X2 is in other intervals, device A exhibits a nonlinear response. In this case, the second interval of the input variable X2 can also be used as the linear response interval of device A. It should be noted that in actual application scenarios, for device A, the linear response intervals corresponding to different input variables may be the same or different.

[0131] The target response feature may include a linear feature. The linear feature corresponds to the linear response interval of N target devices in the acoustic system, where N is an integer greater than or equal to 1. As mentioned above, the N target devices may include at least one device among the speaker 111, the sound sensor 121, the first peripheral circuit 112, and the second peripheral circuit 122. Among them, "the linear feature corresponds to the linear response interval of N target devices in the acoustic system" means that when a certain signal satisfies the linear feature, the N target devices will show a linear response when processing the signal, or in other words, the N target devices will work in a linear response mode. The linear feature may include a numerical interval corresponding to each of at least one input variable. For example, the linear feature may include at least one numerical interval among: an amplitude interval [A1, A2], a frequency interval [f1, f2], a phase interval [w1, w2], a temperature interval [t1, t2], a humidity interval [H1, H2], and a time interval [T1, T2].

[0132] The linear characteristics can be obtained by pre-modeling the linear response conditions of the N target devices. When modeling, a joint modeling method or a separate modeling method can be used. The two modeling methods are introduced below.

[0133] (1) Joint modeling approach.

[0134] During the operation of the acoustic system, the response data of the N target devices can be measured. The response data of each target device may include output data corresponding to different values ​​of the input variables, wherein the input variables include but are not limited to: continuous working time, working frequency, input signal amplitude, power supply voltage, temperature, humidity and other data. Further, the response data of the N target devices are jointly modeled to obtain the linear characteristics. Specifically, based on the response data of the N target devices, the deviation statistics of the response of the N target devices relative to the ideal linear component when the values ​​of the input variables are in different intervals are analyzed. Among them, the deviation statistics may include but are not limited to statistics of at least one dimension of clipping distortion, harmonic distortion, difference frequency distortion, intermodulation distortion, repeatability, hysteresis, and resolution. For example, when the amplitude is in the interval [A1, A2] and the frequency is in the interval [f1, f2], the deviation statistics of the response of the N target devices relative to the ideal linear component are less than a preset threshold. In this case, the linear features obtained by modeling include: an amplitude interval [A1, A2] and a frequency interval [f1, f2].

[0135] It should be understood that the linear characteristics obtained by joint modeling take into account the linear response of the N target devices under the joint action. That is, when a certain signal meets the linear characteristics, the signal will cause the N target devices to work in a linear response mode.

[0136] (2) Separate modeling method.

[0137] During the operation of the acoustic system, the response data of the N target devices can be measured. Then, the response data of each target device is modeled separately to obtain the sub-signal characteristics corresponding to the target device, so that N sub-signal characteristics corresponding to the N target devices can be obtained. Each sub-signal characteristic includes a numerical interval corresponding to at least one input variable. It should be understood that when each target device is modeled separately, the specific modeling method is similar to the joint modeling method, which will not be described here. Furthermore, the linear feature can be determined based on the N sub-signal features. For example, the numerical intervals in the N sub-signal features can be subjected to intersection operations or other operations to obtain the linear feature.

[0138] After the linear characteristic is obtained by modeling, the modulation unit 180 can modulate the signal to be modulated based on the linear characteristic when performing the modulation operation, so that the modulated signal corresponds to the linear response interval of the N target devices. In other words, the purpose of the modulation operation is to make the modulated signal meet the numerical interval specified by the linear characteristic. For example, the modulation unit 180 can use at least one of amplitude modulation, phase modulation, frequency modulation, filter modulation, etc. to adjust the signal to be modulated, so that the modulated signal meets the data interval specified by the linear characteristic. In this way, when the modulated signal is processed by the N target devices, the N target devices will operate in a linear response mode and will not enter a nonlinear response mode.

[0139] Based on the modulation principle of the above modulation operation, the following Figure 5 and Figure 6 The process of the signal processing circuit 150 performing the target operation is exemplified.

[0140] Figure 5 FIG. 2 shows another design schematic diagram of an acoustic system provided according to an embodiment of the present specification. Figure 5 As shown, the modulation unit 180 may be located after the gain amplification unit 130 and before the extraction position of the driving signal u. In this case, the process of the signal processing circuit 150 performing the target operation is as follows:

[0141] (1) The signal processing circuit 150 obtains the driving signal u therein and obtains the sound pickup signal y from the sound pickup assembly 120 .

[0142] (2) Based on the driving signal u, the filtering operation is performed on the sound pickup signal y to obtain the residual signal e.

[0143] Specifically, see Figure 5 , adaptively filter the driving signal u using the prediction transfer function F′ to obtain the signal x′, i.e., x′=u*F′. The signal x′ can be regarded as the predicted value of the feedback component in the sound pickup signal y (i.e., the signal component corresponding to the first sound in the sound pickup signal y). Then, the signal x′ is subtracted from the sound pickup signal y to obtain the residual signal e. i.e., e=yx′=yu*F′. The residual signal e obtained in this way does not contain or contains less feedback sound components.

[0144] (3) Perform the gain amplification operation on the residual signal e to obtain an amplified signal e′, that is, e′=e*G, where G represents the gain amplification factor.

[0145] (4) The amplified signal e′ is used as the signal to be modulated to perform the modulation operation to obtain the first target signal (ie, the driving signal u at the next moment), that is, u=e′*M. Wherein, M represents the transfer function corresponding to the modulation operation.

[0146] Figure 6 FIG. 2 shows another design schematic diagram of an acoustic system provided according to an embodiment of the present specification. Figure 6 As shown, the modulation unit 180 may be located before the gain amplification unit 130. In this case, the process of the signal processing circuit 150 performing the target operation is as follows:

[0147] (1) The signal processing circuit 150 obtains the driving signal u therein and obtains the sound pickup signal y from the sound pickup assembly 120 .

[0148] (2) Based on the driving signal u, the filtering operation is performed on the sound pickup signal y to obtain the residual signal e.

[0149] Specifically, see Figure 6 , adaptively filter the driving signal u using the prediction transfer function F′ to obtain the signal x′, i.e., x′=u*F′. The signal x′ can be regarded as the predicted value of the feedback component in the sound pickup signal y (i.e., the signal component corresponding to the first sound in the sound pickup signal y). Then, the signal x′ is subtracted from the sound pickup signal y to obtain the residual signal e. i.e., e=yx′=yu*F′. The residual signal e obtained in this way does not contain or contains less feedback sound components.

[0150] (3) The residual signal e is used as the signal to be modulated and the modulation operation is performed to obtain the modulated signal e′.

[0151] That is, e′=e*M, where M represents the transfer function corresponding to the modulation operation.

[0152] (4) Performing the gain amplification operation on the modulated signal e′ to obtain a first target signal (ie, the driving signal u at the next moment), that is, u=e′*G, wherein G represents the gain amplification factor.

[0153] based on Figure 5 and Figure 6 According to the theory of adaptive filtering algorithm, the update method of the predicted transfer function F′ can be achieved by minimizing the expectation of the mean square function of the target signal e, that is:

[0154] min F , E[e 2 ]=min F ,E[(yu*F′) 2 ] Formula (1-1)

[0155] Still taking the filtering unit 170 using the LMS algorithm as an example, the above formula (1-2) is derived based on the optimization method of gradient descent, and the update formula of the prediction transfer function F′ can be obtained as follows:

[0156] F′←F′+μ*e*u formula (2-1)

[0157] It can be seen that after obtaining the first target signal u, the signal processing circuit 150 can update the prediction transfer function F′ (i.e. update the parameters of the filtering operation) based on the first target signal u according to the above formula (2-2) to make the filtering operation converge.

[0158] exist Figure 5 and Figure 6 In the scheme shown, the signal processing circuit 150 performs the modulation operation so that the first target signal u output to the sound generating component 110 always operates in the linear response range of the N target devices. It can be understood that when the N target devices include all devices in the sound generating component 110 and the sound pickup component 120, it is equivalent to eliminating all nonlinear response components in the feedback path; when the N target devices include some devices in the sound generating component 110 and the sound pickup component 120, it is equivalent to reducing the nonlinear response components in the feedback path. Therefore, Figure 5 and Figure 6 In the scheme shown, no or fewer nonlinear response components are introduced in the solution of the predicted transfer function F′, thereby improving the convergence performance of the filtering operation and further improving the effect of canceling the feedback sound.

[0159] Figure 7The test results of the acoustic system provided in the embodiment of this specification in terms of filtering performance are shown. Figure 7 In the case where the speaker 111 has a limiting characteristic in the acoustic system, when using Figure 2 When the solution shown in the figure is used, the calculated offset is shown in curve A. Figure 4 When the scheme shown is used, the calculated offset is shown in curve B. The calculation method of the offset has been described in the previous article and will not be repeated here. Figure 7 It can be seen that the use of Figure 4 The scheme shown has significantly improved the convergence degree and convergence speed of the adaptive filtering algorithm. Figure 7 Just an example Figure 2 and Figure 4 Comparison of test results of the solutions shown, Figure 5 and Figure 6 Compared with the scheme shown Figure 2 The scheme shown also has a significant improvement in the convergence degree and convergence speed of the adaptive filtering algorithm, which is not shown as an example in the attached figure.

[0160] The signal processing circuit 150 may be configured to execute the signal processing method described in the embodiments of this specification. In some embodiments, the signal processing circuit 150 may include a plurality of hardware circuits having a connection relationship, each of which includes one or more electrical components, and implements one or more steps of the signal processing method described in the embodiments of this specification when working. For example, the filtering operation, the modulation operation, and the gain amplification operation may be implemented by different hardware circuits or different electrical components, respectively. The above-mentioned multiple hardware circuits cooperate with each other to implement the signal processing method described in the embodiments of this specification when working. In some embodiments, the signal processing circuit 150 may also include a hardware device having a data information processing function and a necessary program required to drive the hardware device to work, and the hardware device implements the signal processing method described in the embodiments of this specification by executing the program. The signal processing method will be described in detail in the following content.

[0161] Figure 8 FIG. 1 shows a hardware structure diagram of an acoustic system provided according to an embodiment of this specification. Figure 8As shown, the signal processing circuit 150 may include: at least one storage medium 210 and at least one processor 220. The at least one processor 220 is in communication with the sound generating component 110 and the sound pickup component 120. It should be noted that, for the purpose of demonstration only, the signal processing circuit 150 in the embodiment of this specification includes at least one storage medium 210 and at least one processor 220. It can be understood by those skilled in the art that the signal processing circuit 150 may also include other hardware circuit structures, which are not limited in the embodiments of this specification, as long as they can meet the functions mentioned in the embodiments of this specification without departing from the spirit of the embodiments of this specification.

[0162] Continue to see Figure 8 In some embodiments, the acoustic system may further include a communication port 230. The communication port 230 is used for data communication between the acoustic system and the outside world. For example, the communication port 230 can be used for data communication between the acoustic system and other devices / systems. In some embodiments, the acoustic system may further include an internal communication bus 240. The internal communication bus 240 can connect different system components. For example, the sound generating component 110, the sound pickup component 120, the processor 220, the storage medium 210 and the communication port 230 can all be connected via the internal communication bus 240.

[0163] The storage medium 210 may include a data storage device. The data storage device may be a non-temporary storage medium or a temporary storage medium. For example, the data storage device may include one or more of a disk 2101, a read-only storage medium (ROM) 2102, or a random access storage medium (RAM) 2103. The storage medium 210 also includes at least one instruction set stored in the data storage device. The instruction set includes instructions, which are computer program codes, and the computer program codes may include programs, routines, objects, components, data structures, processes, modules, etc. for executing the signal processing methods provided in the embodiments of this specification.

[0164] At least one processor 220 is used to execute the at least one instruction set mentioned above. When the acoustic system is running, at least one processor 220 reads the at least one instruction set and executes the signal processing method provided by the embodiment of this specification according to the instructions of the at least one instruction set. The processor 220 can perform all or part of the steps included in the above signal processing method. The processor 220 can be in the form of one or more processors. In some embodiments, the processor 220 may include one or more hardware processors, such as a microcontroller, a microprocessor, a reduced instruction set computer (RISC), an application-specific integrated circuit (ASIC), an application-specific instruction set processor (ASIP), a central processing unit (CPU), a graphics processing unit (GPU), a physical processing unit (PPU), a microcontroller unit, a digital signal processor (DSP), a field programmable gate array (FPGA), an advanced RISC machine (ARM), a programmable logic device (PLD), any circuit or processor capable of performing one or more functions, etc., or any combination thereof. Just for illustration, Figure 8 The acoustic system shown exemplifies a case where only one processor 220 is included. However, it should be noted that the acoustic system provided by the embodiments of the present specification may also include multiple processors, and therefore, the operations and / or method steps disclosed in the embodiments of the present specification may be performed by one processor or jointly by multiple processors. For example, if the processor 220 of the acoustic system performs step A and step B in the embodiments of the present specification, it should be understood that step A and step B may also be performed jointly or separately by two different processors 220 (for example, the first processor performs step A, the second processor performs step B, or the first and second processors perform steps A and B together).

[0165] Fig. 9 1 shows a flow chart of a signal processing method P100 provided according to an embodiment of the present specification. As before, the signal processing circuit 150 in the acoustic system can execute the signal processing method P100 of the present specification. Specifically, the processor 220 can read the instruction set stored in its local storage medium, and then execute the signal processing method P100 of the present specification according to the provisions of the instruction set. Fig. 9 As shown, the signal processing method P100 may include:

[0166] S10: Obtain a driving signal, where the driving signal is a signal for driving a sound-generating component in the acoustic system to emit a first sound.

[0167] S20: Obtaining a sound pickup signal, where the sound pickup signal is obtained by a sound pickup component in the acoustic system picking up ambient sound, where the ambient sound includes the first sound and a second sound from a target sound source.

[0168] It should be understood that the execution order of S10 and S20 can be arbitrary. For example, the signal processing circuit 150 can execute S10 first and then S20, or can execute S20 first and then S10, or can execute S10 and S20 in parallel.

[0169] S30: Perform a target operation based on the driving signal and the picked-up signal to generate a first target signal, and send the first target signal as the driving signal to the sound producing component, wherein the target operation includes a modulation operation and a filtering operation, wherein the filtering operation reduces the signal component corresponding to the first sound in the picked-up signal, and the modulation operation reduces the influence of the nonlinear response component in the target response characteristics of the acoustic system on the convergence performance of the filtering operation.

[0170] In some embodiments, the sound-producing component includes: a speaker and a first peripheral circuit, the first peripheral circuit includes at least one first peripheral device; the sound-picking component includes: a sound sensor and a second peripheral circuit, the second peripheral circuit includes at least one second peripheral device; and the target response characteristic characterizes the response characteristic of at least one target device, the at least one target device includes at least one device among the speaker, the sound sensor, the at least one first peripheral device and the at least one second peripheral device.

[0171] In some embodiments, the target response characteristic includes at least M nonlinear response components, where M is an integer greater than or equal to 1; and the modulation operation is configured to modulate the signal to be modulated by simulating the M nonlinear response components.

[0172] In some embodiments, the target operation also includes a gain amplification operation, and the target operation is performed based on the drive signal and the pickup signal to generate a first target signal, including: performing the modulation operation on the drive signal as the signal to be modulated to obtain a modulated signal; based on the modulated signal, performing the filtering operation on the pickup signal to obtain a residual signal; and performing the gain amplification operation on the residual signal to obtain the first target signal.

[0173] In some embodiments, after obtaining the first target signal, the method further includes: performing the modulation operation on the first target signal to obtain a second target signal; and updating parameters of the filtering operation based on the second target signal to make the filtering operation converge.

[0174] In some embodiments, the M nonlinear response components come from N target devices in the acoustic system, where N is an integer greater than or equal to 1; and the modulation operation is configured to simulate the M nonlinear response components through a target response model, wherein the target response model is obtained by measuring the response data of the N target devices and jointly modeling the response data of the N target devices, or the target response model includes N sub-response models corresponding to the N target devices, wherein the i-th sub-response model is obtained by measuring the response data of the i-th target device and modeling the response data of the i-th target device, and i is a positive integer less than or equal to N.

[0175] In some embodiments, the target response characteristic includes a linear characteristic, which corresponds to a linear response interval of N target devices in the acoustic system, where N is an integer greater than or equal to 1; and the modulation operation is configured to modulate the modulated signal based on the linear characteristic so that the modulated signal corresponds to the linear response interval.

[0176] In some embodiments, the target operation also includes a gain amplification operation, and the target operation is performed based on the drive signal and the pickup signal to generate a first target signal, including: based on the drive signal, performing the filtering operation on the pickup signal to obtain a residual signal; performing the gain amplification operation on the residual signal to obtain an amplified signal; and performing the modulation operation on the amplified signal as the signal to be modulated to obtain the first target signal.

[0177] In some embodiments, the target operation also includes a gain amplification operation, and the target operation is performed based on the drive signal and the pickup signal to generate a first target signal, including: based on the drive signal, performing the filtering operation on the pickup signal to obtain a residual signal; performing the modulation operation on the residual signal as the signal to be modulated to obtain a modulated signal; and performing the gain amplification operation on the modulated signal to obtain the first target signal.

[0178] In some embodiments, after obtaining the first target signal, the method further includes: updating parameters of the filtering operation based on the first target signal so that the filtering operation tends to converge.

[0179] In some embodiments, the linear feature is obtained by measuring the response data of the N target devices and jointly modeling the response data of the N target devices to obtain the linear feature; or, the linear feature is obtained by measuring the response data of the N target devices, modeling the response data of each target device respectively to obtain N sub-signal features corresponding to the N target devices, and determining the linear feature based on the N sub-signal features.

[0180] In some embodiments, the filtering operation comprises an adaptive filtering operation; and the modulation operation comprises at least one of amplitude modulation, phase modulation, frequency modulation, and filtering modulation.

[0181] It should be noted that the detailed implementation of the signal processing method P100 can be found in the relevant description of the acoustic system above. Its implementation principle and technical effect are similar and will not be repeated here.

[0182] In summary, in the solution provided in this specification, the sound-generating component in the acoustic system converts the driving signal into the first sound when working, and the sound-collecting component picks up the ambient sound and generates the sound-collecting signal when working, wherein the ambient sound includes the first sound and the second sound from the target sound source, and the signal processing circuit is connected to the sound-generating component and the sound-collecting component, and performs the target operation based on the driving signal and the sound-collecting signal to generate the first target signal when working, and sends the first target signal as the driving signal to the sound-generating component, wherein the target operation at least includes a modulation operation and a filtering operation. Since the filtering operation reduces the signal component corresponding to the first sound in the sound-collecting signal, the solution provided in this specification can reduce or eliminate the feedback sound, thereby avoiding the problem of howling caused by the feedback sound, and helps to improve the maximum sound gain that the acoustic system can achieve. Furthermore, since the modulation operation reduces the influence of the nonlinear response component in the target response characteristic of the acoustic system on the convergence performance of the filtering operation, the solution provided in this specification can also improve the convergence performance of the filtering operation, thereby further improving the cancellation effect of the feedback sound.

[0183] On the other hand, the present specification provides a non-transitory storage medium storing at least one set of executable instructions for signal processing. When the executable instructions are executed by the processor, the executable instructions instruct the processor to implement the steps of the signal processing method P100 described in the present specification. In some possible implementations, various aspects of the present specification can also be implemented in the form of a program product, which includes a program code. When the program product is run on an acoustic system, the program code is used to make the acoustic system perform the steps of the signal processing method P100 described in the present specification. The program product for implementing the above method can use a portable compact disk read-only memory (CD-ROM) to include program code and can be run on an acoustic system. However, the program product of the present specification is not limited to this. In the present specification, the readable storage medium can be any tangible medium containing or storing a program, which can be used by the instruction execution system or used in combination with it. The program product can use any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media include: an electrical connection with one or more conductors, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. The computer-readable storage medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, device, or device. The program code contained on the readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above. Program code for performing the operations of the present specification may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the acoustic system, partially on the acoustic system, as a stand-alone software package, partially on the acoustic system and partially on a remote computing device, or entirely on a remote computing device.

[0184] The above is a description of a specific embodiment of the present specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require a specific order or a continuous order to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0185] In summary, after reading this detailed disclosure, those skilled in the art will appreciate that the foregoing detailed disclosure may be presented only by way of example and may not be limiting. Although not explicitly stated herein, those skilled in the art will appreciate that this specification requires various reasonable changes, improvements and modifications to the embodiments. These changes, improvements and modifications are intended to be proposed by this specification and are within the spirit and scope of the exemplary embodiments of this specification.

[0186] In addition, certain terms in this specification have been used to describe embodiments of this specification. For example, "one embodiment", "an embodiment" and / or "some embodiments" mean that a particular feature, structure or characteristic described in conjunction with the embodiment may be included in at least one embodiment of this specification. Therefore, it can be emphasized and should be understood that two or more references to "an embodiment" or "one embodiment" or "an alternative embodiment" in various parts of this specification do not necessarily refer to the same embodiment. In addition, specific features, structures or characteristics may be appropriately combined in one or more embodiments of this specification.

[0187] It should be understood that in the foregoing description of the embodiments of this specification, in order to help understand a feature and for the purpose of simplifying this specification, this specification combines various features in a single embodiment, figure or its description. However, this does not mean that the combination of these features is necessary. When reading this specification, it is entirely possible for a person skilled in the art to mark out some of the devices as separate embodiments. In other words, the embodiments in this specification can also be understood as the integration of multiple secondary embodiments. This is also true when the content of each secondary embodiment is less than all the features of a single aforementioned disclosed embodiment.

[0188] Each patent, patent application, patent application publication, and other material, such as articles, books, specifications, publications, documents, articles, etc., cited herein, except any historical prosecution documents to which it is relevant, any equivalent that may be inconsistent or conflicting with this document, or any equivalent historical prosecution documents that may have a limiting effect on the broadest scope of the claims, may be incorporated herein by reference and used for all purposes now or hereafter associated with this document. In addition, in the event of any inconsistency or conflict between the descriptions, definitions, and / or use of terms associated with any of the incorporated materials and the terminology, descriptions, definitions, and / or use associated with this document, the terminology in this document shall control.

[0189] Finally, it should be understood that the embodiments of the application disclosed herein are explanations of the principles of the embodiments of this specification. Other modified embodiments are also within the scope of this specification. Therefore, the embodiments disclosed in this specification are only used as examples and not as limitations. Those skilled in the art can adopt alternative configurations according to the embodiments in this specification to implement the applications in this specification. Therefore, the embodiments of this specification are not limited to the embodiments accurately described in the application.

Claims

1. An acoustic system, characterized in that: include: A sound producing component, which converts a driving signal into a first sound when in operation; A sound pickup component, which picks up ambient sound and generates a sound pickup signal when in operation, wherein the ambient sound includes the first sound and a second sound from a target sound source; as well as The signal processing circuit is connected to the sound producing component and the sound pickup component, and when in operation: performing a target operation based on the drive signal and the picked-up sound signal to generate a first target signal, and The first target signal is sent to the sound generating component as the driving signal, wherein The target operation includes at least a modulation operation and a filtering operation, The filtering operation reduces the signal component corresponding to the first sound in the picked-up sound signal, The modulation operation reduces the influence of nonlinear response components in the target response characteristics of the acoustic system on the convergence performance of the filtering operation.

2. The acoustic system according to claim 1, characterized in that The pronunciation component includes: Speakers, and a first peripheral circuit connected to the speaker and the signal processing circuit and comprising at least one first peripheral device; The pickup assembly comprises: Sound sensor, and a second peripheral circuit connected to the sound sensor and the signal processing circuit and comprising at least one second peripheral device; and The target response characteristic represents a response characteristic of at least one target device, wherein the at least one target device includes at least one device among the speaker, the sound sensor, the at least one first peripheral device, and the at least one second peripheral device.

3. The acoustic system according to claim 1, characterized in that The target response characteristic includes at least M nonlinear response components, where M is an integer greater than or equal to 1; and The modulation operation is configured to modulate the to-be-modulated signal by simulating the M nonlinear response components.

4. The acoustic system according to claim 3, characterized in that The target operation further includes a gain amplification operation. When the signal processing circuit performs the target operation: Performing the modulation operation on the driving signal as the signal to be modulated to obtain a modulated signal; Based on the modulated signal, performing the filtering operation on the sound pickup signal to obtain a residual signal; as well as The gain amplification operation is performed on the residual signal to obtain the first target signal.

5. The acoustic system according to claim 4, characterized in that After obtaining the first target signal, the signal processing circuit further: performing the modulation operation on the first target signal to obtain a second target signal; and The parameters of the filtering operation are updated based on the second target signal to make the filtering operation converge.

6. The acoustic system according to claim 3, characterized in that The M nonlinear response components come from N target devices in the acoustic system, where N is an integer greater than or equal to 1; as well as The modulation operation is configured to simulate the M nonlinear response components through a target response model, wherein, The target response model is obtained by measuring the response data of the N target devices and jointly modeling the response data of the N target devices, or The target response model includes N sub-response models corresponding to N target devices, wherein the i-th sub-response model is obtained by measuring the response data of the i-th target device and modeling the response data of the i-th target device, and i is a positive integer less than or equal to N.

7. The acoustic system according to claim 1, characterized in that The target response characteristic includes a linear characteristic, and the linear characteristic corresponds to a linear response interval of N target devices in the acoustic system, where N is an integer greater than or equal to 1; as well as The modulation operation is configured to modulate the signal to be modulated based on the linear characteristic so that the modulated signal corresponds to the linear response interval.

8. The acoustic system according to claim 7, characterized in that The target operation further includes a gain amplification operation. When the signal processing circuit performs the target operation: Based on the driving signal, performing the filtering operation on the sound pickup signal to obtain a residual signal; Performing the gain amplification operation on the residual signal to obtain an amplified signal; and The modulation operation is performed using the amplified signal as the signal to be modulated to obtain the first target signal.

9. The acoustic system according to claim 7, characterized in that The target operation further includes a gain amplification operation. When the signal processing circuit performs the target operation: Based on the driving signal, performing the filtering operation on the sound pickup signal to obtain a residual signal; Performing the modulation operation on the residual signal as the signal to be modulated to obtain a modulated signal; as well as The gain amplification operation is performed on the modulated signal to obtain the first target signal.

10. The acoustic system according to claim 8 or 9, characterized in that: After obtaining the first target signal, the signal processing circuit further: Parameters of the filtering operation are updated based on the first target signal to make the filtering operation converge.

11. The acoustic system according to claim 7, characterized in that The linear feature is obtained by measuring the response data of the N target devices and performing joint modeling on the response data of the N target devices to obtain the linear feature; or The linear characteristic is obtained in the following manner: measuring the response data of the N target devices, modeling the response data of each target device respectively to obtain N sub-signal characteristics corresponding to the N target devices, and determining the linear characteristic based on the N sub-signal characteristics.

12. The acoustic system according to claim 1, characterized in that The filtering operation comprises an adaptive filtering operation; and The modulation operation includes at least one of amplitude modulation, phase modulation, frequency modulation, and filter modulation.

13. A signal processing method, characterized in that: Included, through signal processing circuits in the acoustic system: Obtaining a driving signal, wherein the driving signal is a signal for driving a sound-generating component in the acoustic system to emit a first sound; Obtaining a sound pickup signal, where the sound pickup signal is obtained by a sound pickup component in the acoustic system picking up ambient sound, where the ambient sound includes the first sound and a second sound from a target sound source; as well as A target operation is performed based on the driving signal and the sound pickup signal to generate a first target signal, and the first target signal is sent to the sound generating component as the driving signal, wherein The target operation includes a modulation operation and a filtering operation, The filtering operation reduces the signal component corresponding to the first sound in the picked-up sound signal, The modulation operation reduces the influence of nonlinear response components in the target response characteristics of the acoustic system on the convergence performance of the filtering operation.

14. The method according to claim 13, characterized in that The pronunciation component includes: Speakers, and A first peripheral circuit includes at least one first peripheral device; The pickup assembly comprises: Sound sensor, and A second peripheral circuit includes at least one second peripheral device; and The target response characteristic represents a response characteristic of at least one target device, and the at least one target device includes at least one device among the speaker, the sound sensor, the at least one first peripheral device, and the at least one second peripheral device.

15. The method according to claim 13, characterized in that The target response characteristic includes at least M nonlinear response components, where M is an integer greater than or equal to 1; and The modulation operation is configured to modulate the to-be-modulated signal by simulating the M nonlinear response components.

16. The method according to claim 15, characterized in that The target operation further includes a gain amplification operation, and the target operation is performed based on the drive signal and the sound pickup signal to generate a first target signal, including: Performing the modulation operation on the driving signal as the signal to be modulated to obtain a modulated signal; Based on the modulated signal, performing the filtering operation on the picked-up sound signal to obtain a residual signal; and The gain amplification operation is performed on the residual signal to obtain the first target signal.

17. The method according to claim 16, characterized in that After obtaining the first target signal, the method further includes: performing the modulation operation on the first target signal to obtain a second target signal; and The parameters of the filtering operation are updated based on the second target signal to make the filtering operation converge.

18. The method according to claim 15, characterized in that The M nonlinear response components come from N target devices in the acoustic system, where N is an integer greater than or equal to 1; as well as The modulation operation is configured to simulate the M nonlinear response components through a target response model, wherein, The target response model is obtained by measuring the response data of the N target devices and jointly modeling the response data of the N target devices, or The target response model includes N sub-response models corresponding to N target devices, wherein the i-th sub-response model is obtained by measuring the response data of the i-th target device and modeling the response data of the i-th target device, and i is a positive integer less than or equal to N.

19. The method according to claim 13, characterized in that The target response characteristic includes a linear characteristic, and the linear characteristic corresponds to a linear response interval of N target devices in the acoustic system, where N is an integer greater than or equal to 1; as well as The modulation operation is configured to modulate the signal to be modulated based on the linear characteristic so that the modulated signal corresponds to the linear response interval.

20. The method according to claim 19, characterized in that The target operation further includes a gain amplification operation, and the target operation is performed based on the drive signal and the sound pickup signal to generate a first target signal, including: Based on the driving signal, performing the filtering operation on the sound pickup signal to obtain a residual signal; Performing the gain amplification operation on the residual signal to obtain an amplified signal; and The modulation operation is performed using the amplified signal as the signal to be modulated to obtain the first target signal.

21. The method according to claim 19, characterized in that The target operation further includes a gain amplification operation, and the target operation is performed based on the drive signal and the sound pickup signal to generate a first target signal, including: Based on the driving signal, performing the filtering operation on the sound pickup signal to obtain a residual signal; Performing the modulation operation on the residual signal as the signal to be modulated to obtain a modulated signal; and The gain amplification operation is performed on the modulated signal to obtain the first target signal.

22. The method according to claim 20 or 21, characterized in that After obtaining the first target signal, the method further includes: Parameters of the filtering operation are updated based on the first target signal to make the filtering operation converge.

23. The method according to claim 19, characterized in that The linear feature is obtained by measuring the response data of the N target devices and performing joint modeling on the response data of the N target devices to obtain the linear feature; or The linear characteristic is obtained in the following manner: measuring the response data of the N target devices, modeling the response data of each target device respectively to obtain N sub-signal characteristics corresponding to the N target devices, and determining the linear characteristic based on the N sub-signal characteristics.

24. The method according to claim 13, characterized in that The filtering operation comprises an adaptive filtering operation; and The modulation operation includes at least one of amplitude modulation, phase modulation, frequency modulation, and filter modulation.

Citation Information

Patent Citations

  • Loudspeaker device

    CN101233783A

  • Auto-tuning Of Non-linear Processor Threshold

    CN104980600A

  • Digital hearing aid howling suppression system and suppression method thereof

    CN114584909A

  • Apparatus and method for canceling acoustic echoes including non-linear distortions in loudspeaker telephones

    CN1176034A

  • Apparatus and method for adaptively precompensating for loudspeaker distortions

    CN1176042A